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(57) In order to realise a high picture quality with a 
small information volume, to reduce the 
hardware scale and to reduce the capacity of 
the frame buffer of a decoder, a limitation mode 
decision circuit 34 adaptively changes over a 
mode of inhibiting interframe predictive coding 
over the entire macro-blocks in each slice to a 
mode of inhibiting interfield predictive coding 
in a frame being encoded over the entire mac- 
ro-blocks in one slice. As for a B-frame, predic- 
tion from its odd field to its even field is 
inhibited, while prediction from an odd field, 
such as an lo field, of a reference frame of 
forward prediction is also inhibited. 
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This invention relates to a technique for encoding of image signals by orthogonal transformation, a record- 
ing medium on which data encoded by the technique is recorded, and a technique for decoding the encoded 

As a system for the high efficiency encoding of image signals, the Moving Picture Experts Group (MPEG) 
has proposed a draft standardization which prescribes a high efficiency encoding arrangement for picture sig- 
nals for d.g.tal storage media. The storage media contemplated in the proposed arrangement are those having 
a continuous ifransfer rate of not higher than 1.5 M bit/sec, such as a compact disc (CD), digital audio tape 
recorder (DAT) or a hard disc. According to the draft standardization, the storage medium may be directly con- 
nected to a decoder or it may be connected thereto via a transmission medium such as a computer bus local 
area network (LAN) or telecommunication link. It is contemplated by the draft standardization to implement 
special functions such as random accessing, high-speed playback or reverse playback, in addition to the usual 
Torward playback. 

In the arrangement proposed by MPEG for high efficiency encoding of picture signals, redundancy along 
the bme axis is owered by encoding the difference between pictures, and subsequently redundancy along the 
spatial axes is lowered by employing discrete cosine transform (DCT) and variable length encoding 

With respect to redundancy along the time axis, in moving pictures, a picture under consideration, that is 
a picture at a given point in time, generally bears a strong resemblance to temporally previous and temporally 
posterior pictures. Consequently, if the difference between the picture now to be encoded and the picture tem- 
porally preceding it is taken and transmitted, as shown in Figure 44, then it becomes possible to lower the re- 
dundancy along time axis to diminish the volume of information to be transmitted. A picture encoded in this 
manner is termed a forwardly predictive-coded picture, P picture or a P frame. Similarly, if the difference is 
taken between the picture now to be encoded on the one hand and the picture temporally preceding it and 
the picture temporally succeeding it or interpolated pictures produced from the preceding and succeeding pic- 
tures, and a smaller one of the resulting differences is transmitted, it becomes possible to lower further the 
redundancy along time axis to diminish the volume of information to be transmitted. The picture encoded in 
this manner is termed a bidirectionally predictive-coded picture, B picture or a B frame 

The pictures shown at I, P and B in Figure 44 represent an intracoded picture. I picture or I frame, as later 
explained, as well as the above-mentioned P picture and B picture, respectively 

The respective predicted pictures (referred to as predictivecoded pictures) are produced by so-called 
movement compensation. ' 

As an example of movement compensation, a block consisting of, for example, 16 ♦ 16 pixels, which is 
formed of four unit blocks each of, for example, 8 . 8 pixels, is prepared. The 16 . 16 pixel block is termed a 
macro-block. The macro-block of the temporally previous picture in the vicinity of a given macro-block of a cur- 
rent picture exhibiting the least difference from the macro-block of the current picture is found by searching 
and a difference therebetween is taken to enable a reduction of the data to be transmitted. For the P-picture 
a picture produced by taking the difference between the picture now to be encoded and the predicted picture 
following movement compensation or a picture produced without taking the difference between the picture to 
be encoded and the predicted picture following movement compensation, whichever exhibits less data volume 
is selected and encoded from one 1 6 • 1 6 pixel macro-block to another. 

However, in t he above case, more data needs to be transmitted for a picture portion which has just emerged 
from behind an object which has been moved. For a B-picture. decoded temporally previous or temporally pos- 
tenor pictures following movement compensation, an interpolated picture produced by adding these pictures 
or a picture to be encoded, whichever is the least in data volume, is encoded 

With respect to redundancy along spatial axes, the differences of the picture data are not directly trans- 
mitted, but are discrete cosine transformed from one 8 . 8 pixel block to another. The discrete cosine transform 
(DCT) expresses a picture not on the pixel level, but as a function of which of the frequency components of a 
cosine function are contained in a picture and the amounts of the frequency components contained in that pic- 
hire For example, data contained in a 8 * 8 pixel unit block are transformed by two-dimensional DCT into a 
block of 8 . 8 coefficients of the components of the cosine function. It is known that picture signals of a natural 
scene taken by a television camera tends to be smooth signals. In such case, the data volume may be efficiently 
diminished by discrete cosine transforming the picture signals. 

Thus, in the case of smooth signals, such as picture signals of the natural scene, larger values are con- 
centrated about a certain coefficient. If the coefficient is quantized, the 8 . 8 coefficient block becomes sub- 
stantially equal to zero, while larger coefficients are left. For transmitting data of the 8 . 8 coefficient block 
non-zero coefficients and a zero run indicating how many Os are present in front of the coefficient are grouped 
into a set in the sequence of a so-called zig-zag scan, which set is transmitted as a Huffman code for dimin- 
ishing th amount of information that needs to be transmitted. The image is re-constructed in the rev rse se- 
quence at the decoding side. " " " 
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coml^f f h i ^? hand ' ed by th6 above - described encoding arrangement is shown in Figure 45 and is 
composed of a block layer, a macro-block layer, a slice layer, a picture layer, a group of pictures (GOP) layer 

fTrr^^^^^ 

Dixels'tS^ 

pixels, that s 8 ne,ghbonng luminance pixels in 8 lines or 8 neighboring colour difference pixels in 8 lines Th* 
above-mentioned DCT is performed for each of these 8 . 8 blocks a '" e rence P'*eis in 8 l.nes. The 

boringllT^ 

uonng luminance blocks YO, Y1, Y2and Y3, and colour difference blocks (unit colour difference blocks! Cran* 

» « ^d»Z»r' „ ^ ? ° b - Wh "* °" hs bk "* 9 isua<Kl as • Pidtore for taking differenoeo 

« <-» otftowtoe noods to b. trannmitM is dotorntinod by tho encoding oyotomL, on. maJioTtoT 

Odor.™" So 5S SS^iS 2°"* ma<!ro - W ° < * s ««* « m tl» piototo ncnning so. 

o„ th" E?" ' ayer ' the piCtUreS 3re each made "P <* at least one ^d preferably plural slices Deoendino 
onheencod.ngsystem.thepicturesaredassifiedintotheabove-mentionedm 
ZXTt h f f0rWard,y P redictive -coded P'^es, P-pictures or P-frames. UdtoZS 
Pictures B-pictures or B-frames, and DC intra-coded pictures, or DC coded D) pictures 

movln ! d i CtUre ° r l " PiCtUre ' ° nly the informa «o" contained with the pariicular picture is em- 

tSU t£ r JT f*" ^ be re - constituted °" decoding only by the information rfttSiS 

ESS ? 18 ^ diSCr6te C ° Sine end encoded without taking a difference be ween 

at ai*Hw y ? ' 9h the encodin 9 system is generally low in efficiency, l-p^res may be inserted 
at arbrtrary positions to enable random access and high-speed playback 

In the forwardly predictive-coded picture or P-picture. the l-picture or P-picture which is temoorallv orevi 
ous and has already been decoded is employed as a reference picture for dif ference tekini hK! dS" 
enca between the present picture and the movement-compensation refe^Z^ZeX^^ 

3 f r renCe (int,a ' COded PiCtUre) ' WhiCneV6r iS m0re efficient - « SwTSSff 
and this selection is made from one macro-block to another ""wwmg, 

nr^i„ e ^" e ? i ° nal,y ^P^icfive-ooded picture or B-picture. three reference pictures, namely the temoorallv 
preceding already decoded l-picture or P-picture and interpolated pictures produced from boCf these 2 

Z TlrZ S/; C T g, t fcheVer iS m ° St efffctent ' iS Se,eCted from one macro-bioS to ar h e" 
DCT ™« ~„ f > f,, te ,S tHe rtM,ded encoded P icture constituted only by the DC coefficients of 
DCT and cannot exist in the same sequence as the other three pictures (i.e. the I. P or B pichW 

if t J he n 9i ; 0u ^ f -P |Ctur e (GOP) "ever is made up of one or plural .-pictures and zero or p.uSZ i pictures 
decoderV^^ 

r D ;i h : T on such chan9e in the sequence is ^ in ihe ^ KSSt 

tZZ «; 2 ?TZ th3t refere " Ce PiCture ' that is the tem P° ral, y l-picture or pXre ue 

present at the time the B-p lc ture is to be encoded or decoded. The distance between the l-oictures or t he di<? 
fence between the .-picture and B-picture, is arbitrary. Besides, the distance between *e . Ss o "he p 

picferesmaynaturallybe changed withintheGOP layer. The boundary betweentheGOP^^^^^^^^ 
by ^The .-picture, P-picture and the B-picture are represented by I. P and B. respecter 

rate, etc S6qUenCe * by "* °' ^ G ° P ,ayers havif * the **™ picture size, picture 

MPEG h rntJl ma Ki 2ed TJ' m9 PidUre fe t0 tranSmitted by the hi 9 n eff^ency encoding arrangement of 

the s ™, S2T ? C ° u mPreSSin9 data Wi,hin the picture is ^ensmitted, and then a difference from 

the same picture processed with movement compensation is transmitted 

fWHc T,? I'?! f ° r eXamplei iS Passed as a picture, vertical positions become different between two 
fields, so that difference data needs to be transmitted for transmitting e.g. a still picture 

For processing a frame as a picture, a picture deformed in a comb shap needs to be processed as lona 
as a moving portion in the frame is concerned. For xample, in Figure 46. if a moving objert CA such a?! 
ca,,spresentaheadofasfetionarybackgroun^^^ 
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for the portion of th moving object becomes zig-zag shaped in contour as indicated at KS. 

For processing a picture in which a stationary portion and a moving porion exist together, there is produced 
a picture portion in the picture which is low in compression efficiency, regardless of whether the field is proc- 
essed as a picture or the frame is processed as a picture. 
5 The invention addresses the problem of providing a high efficiency encoding technique for encoding picture 

signals whereby field or frame processing of a field-based video picture may be carried out efficiently regard- 
less of whether the picture contains a subject that undergoes little motion or abundant motion. 

Various aspects of the invention are set out in the accompanying claims. 

Embodiments of the invention will now be described, by way of example only, with reference to the ac- 
10 companying drawings in which: 

Figure 1 is a block diagram showing a schematic arrangement of a high efficiency encoding apparatus; 
Figure 2 shows an example of macro-block; 

Figure 3 shows an example of macro-block for a frame processing mode; 
Figure 4 shows an example of macro-block for a f ield processing mode; 
15 Figure 5 is a block diagram showing an arrangement of a high efficiency encoding device for picture signals 
of a second embodiment, 

Figure 6 shows the manner of encoding by encoding devices of the f irst and second embodiments; 
Figure 7 shows a unit block for DCT of the frame processing mode/field processing mode for a typical for- 
mat of a digital VTR; 
20 Figure 8 shows the manner of motion prediction in Figure 7; 
Figure 9 shows a modification of Figure 7; 

Figure 10 shows the manner of motion prediction in the modification of Figure 9; 
Figure 11 shows a unit block for DCT of the frame processing mode/f ield processing mode for another typ- 
ical format of a digital VTR; 
25 Figure 12 shows another modification of Figure 7; 
Figure 13 shows a set of macro-blocks; 

Figure 14 shows the manner of processing in accordance with the frame processing mode with Figure 1 3; 

Figure 15 shows the manner of processing in accordance with the field processing mode with Figure 13; 

Figure 16 shows a modification (for forward prediction) of extension bit addition in the encoding device of 
30 second embodiment; 

Figure 1 7 is a block diagram showing an arrangement of a decoder which is a counterpart of the encoding 

devices of first and second embodiments; 

Figure 18 shows a picture of an odd cycle; 

Figure 19 shows a picture of an even cycle; 
35 Figure 20 is a block diagram showing a schematic arrangement of a high efficiency encoding device for 

picture signals of a third embodiment- 
Figure 21 is a block diagram showing a schematic arrangement of a high efficiency encoding device for 

picture signals of a fourth embodiment; 

Figure 22 is a block diagram sowing a schematic arrangement of a modification of the high efficiency en- 
40 coding device for picture signals of third embodiment; 

Figure 23. is a flow chart for explaining a first modification of processing by limitation mode selecting means 
in the high efficiency encoding device for picture signals of the third embodiment; 
Figure 24 shows motion vectors from an odd field to an even field; 

Figure 25 is a flow chart for explaining a second modification of processing by limitation mode selecting 
45 means in the high efficiency encoding device for picture signals of third embodiment; 

Figure 26 is a flow chart for explaining a third modification of processing by limitation mode selecting 

means in the high efficiency encoding device for picture signals of third embodiment; 

Figure 27 is a flow chart for explaining a fourth modification of processing by limitation mode selecting 

means in the high efficiency encoding device for picture signals of third embodiment; 
so Figure 28 is a flow chart for explaining a fifth modification of processing by limitation mode selecting means 

in the high efficiency encoding device for picture signals of third embodiment; 

Figure 29 shows motion prediction for the second limitation mode and frame processing mode; 

Figure 30 shows motion prediction for the second limitation mode and field processing mode; 

Figure 31 shows motion prediction for the first limitation mode; 
55 Figure 32 is a block diagram showing a schematic arrangement of an encoding device (modification) of 

th second embodiment; 

Figure 33 is a block diagram showing an arrangement of a third decoding device; 

Figure 34 is a block diagram showing a schematic arrangement of a high efficiency encoding device for 

4 
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picture signals of a fifth embodiment 

Figure 35 shows the code decoding and display sequence by the fifth encoding device- 
Figure 36 shows the code decoding and display sequence by the second (or third) encoding device- 
Figure 37 shows the manner of motion prediction in th fifth encoding device; 
Figure 38 is a block diagram showing an arrang ment of the fifth decoding device- 
Figure 39 shows the code decoding and display sequence by the fifth d coding device- 
Figure 40 is a block diagram showing a schematic arrangement of a high efficiency encoding device for 
picture signals of a sixth embodiment; ■gueviceror 

Figure 41 shows the code decoding and display sequence by the sixth decoding device- 
Figure 42 shows the manner of motion prediction in the sixth encoding device- 
Figure 43 is a block diagram showing an arrangement of the sixth decoding device- 
Figure 44 shows several prediction pictures; 
Figure 45 shows a data structure; and 
Figure 46 shows a picture having a moving object 

Figure 1 shows an embodiment 1 of the high efficiency encoding device for picture signals i which en- 
T rt ?r1« With 1 ma , Cr °- b,0ck ' which is a two-dimensional array of pixels smaller than a screen, con- 
sisting e.g. of 16 . 16 pixels of input picture data arrayed in a spatial sequence of input picture data, as a unit 

bSin ,nCU ? eS 3 9r ° UP 1 ^ mem ° rieS 10forstori "9 P'"^' "ames, each consisting of plurai 
unit blocks of 16 . 6 pucels, as original pictures, and a frame movement detection circuit 22 and a field move- 

mUZO^- T \t m ° Vement deteCti0 " mea " S> f ° r detectinfl the sum of the differences of absolute 
™ h Til P ' X I the movement vectore betwe «" ^e frames or between the fields. Each field is com- 
S!Sf ° dd -" umbe ; ed ** even-numbered scanning lines of the frame pixels and is divided on the basis of 

SS£^SK^Tt5^ a *?■ The encodin9 device also indudes a movement ™<«° 

* " h. t ? 24 ' 88 f ifSt m0de SeleCtinfl means ' for decidi "9' based on the output infor- 

i ^ 1 deteCt,0n meanS> " hk * of the frame P redictive ««>de for movement compensation 
^ tht fL^h me T l a ^- b,ock as a unit orthe f ^ P^ictive mode for movement oompensalSon based 
on he field ,n the macro-block as a unit and selecting the prediction mode with a hfcher efficiency. The en- 

XZT° ,k ? a bl ° ck - formi "9 mode decfefo " cireuit 25, as second mode selecting means, for 
m«?o 9 J ITI* . ° P ,nformation from the movement detection means and the first mode selecting 
P" 50683 " 19 m0de ° f f0rming b '°cks for effectuating orthogonal transform based on 
the frame in the macro-block as a unit or the field processing mode of forming blocks for effectuating ortho- 

sele*^ 

selecting the mode w.th a higher efficiency. The encoding device also includes an address generator 11 as 

i2£S?ir tin9meanS ' forre ~ 9ni2in 9 whether thecydeisanodd-numbered cycle of scanningthe odd- 
numbered field or an even-numbered cycle of scanning the even-numbered field in the interlaced scanning 
of an encoding operation for a frame and for controlling the group of frame memories for outputting macro- 
s' f the odd-numbered cycles for the selected block-forming mode. The encoding J£T2£ 

me a nTfor 9roUP ^V^Tf 2 ° f " Bd With 3 m0vement « movement compensating 

Z thl 1 7 J* b . IOCk - f ° rmin 9 mode informat ™ as selected by the second mode selecting means 
Potion mode information as selected by the first mode means and executing prediction 
movement-compensated fields or frames. 

sh Jn h rFlgurei am0f PiCtUredata l ° be e " COded ln ^P 161 ^explained with reference to the arrangement 

m JnS^o n d ? ita i f^Tf Si9 " alS are SUPP ' ied t0 input terminal 1 so as to be stored in the group of frame 
^ or 2 °t the 16 . 16 unit macro-blocks are read from the group of frame memones 10, under 
control of address generator 11 as later explained, and transmitted to a difference detection unit 12. Movement- 
s' E Z data fr ° m *? 9r ° UP ° f frame mem ° rieS 20 3re a,S ° SUpp,ied t0 the difference lection 
unit 12 where the differences in the picture data are detected. 

tonSJO! S™ ^f^^ det6Cti0n Unit 12 iS Supplied t0 a DCT circuit 13 for effectuating orthogonal 
fransform (DCT). DCT coefficient data from the DCT circuit 13 are transmitted to a quantizer 14 Quantized 
date from quantizer -Uan transmitted to a variable length encoding circuit 1 5 for effectuating a variable length 
encoding, such as Huffman encoding or run-length encoding, and outputted at output terminal 2 via buffer 16 
as encoded data. 

The quantized data from the quantizer 14 are supplied to the frame memory group 20 fitted with the move- 
ZTrt^TT ' ^ dequanti2er 1 7 f ° r 6f feCtU3tin9 de£ » ua "tization which is the reverse of the quantization 
tte reverS ZlZT" i' a " DCT *"* 18 f0r effectua «"9 *" inverse DCT operation which is 

5 Z ! ,* ° Pe '° n Perf ° rmed by ° CT Circuit 13 ' and an additive "°de 19. The additive node 

19 adds an output of the inverse DCT circuit 18 and an output of the frame memory group 20 fitted with the 
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movement compensator. Meanwhile, signals for inhibiting verflow of the buffer 16 are fed back from buffer 
16 to quantizer 14. 

On the other hand, picture data outputted from frame memory group 1 0 from one macro-block to another 
are transmitted to a fram movement detection circuit 22 and a field movement d t ction circuit 21 . 

5 The frame mov m nt detection circuit 22 d tects and the motion vectors between frames and th sums 

of the absolute values of the differences between pixels from one macro-block to another and outputs these 
data, that is data of motion vectors between frames FMMV and the sums of the absolute values of the differ- 
ences FMAD. The field movement detection circuit 21 detects the sums of the absolute values of the differ- 
ences of the pixels from one macro-block to another to output these data, that is data of motion vectors between 

10 fields FDMV and the sums of the absolute values of the differences FDAD. The motion vector data 
FMM V/FDMV of these motion vector detection circuits 21 , 22 are transmitted to selector 24, while the data of 
the sum of the absolute values of the differences FMAD/FDAD are transmitted to the movement prediction 
mode decision circuit 23. 

The movement prediction mode decision circuit 23 decides, based on the data of the sums of the absolute 

15 values of the differences FMAD from frame movement detection circuit 22 and the data of the sums of the 
absolute values of the differences FDAD from field movement detection circuit 21 , as to whether the movement 
prediction is to be made on the frame-by-frame basis or on the field-by-field basis at the time of the movement 
prediction at the frame memory group fitted with the movement compensator 20, and outputs data indicating 
a processing mode which is more advantageous or efficient. Specifically, if the difference between the sums 

20 of the absolute values of the differences FMAD and FDAD is found to be larger than a predetermined threshold 
T1 (FMAD - FDAD > T1) by the movement prediction mode decision unit 23, data indicating that the field-by- 
field movement prediction is more efficient (data MPFD for the field processing mode for movement prediction) 
is outputted from circuit 23. Conversely, if the difference between the sums of the absolute values of the dif- 
ferences FMAD and FDAD is found to be smaller than or equal to a predetermined threshold T1 (FMAD - FDAD 

25 ^@T1), data indicating that the frame-by-frame movement prediction is more efficient (data MPFM for the 
frame processing mode for movement prediction) is outputted from circuit 23. The outputted movement pre- 
diction mode data MPFM/MPFD is transmitted to the frame memory group 20 fitted wit movement compensator 
which then effectuates frame- by-frame or field-by-field movement compensation. The movement prediction 
mode data MPFM/MPFD are also transmitted to selector 24. 

30 The selector 24 selects, responsive to the motion prediction mode data MPFM/MPFD from motion predic- 
tion mode decision circuit 23, the frame-to-frame motion vector data FMMV supplied from frame motion detec- 
tion circuit 22 or the field-to-field motion vector data FDMV supplied from field motion detection circuit 21 . That 
is, if the motion prediction mode data is the data MPFD indicating the field prediction mode data MPFD, selector 
24 selects and outputs the motion vector data FDMV from field motion detection circuit 21 , whereas, if the mo- 

35 tion prediction mode data is the data MPFM indicating the frame prediction mode data MPFM, selector 24 se- 
lects and outputs the motion vector data FMMV from frame motion detection circuit 22. The motion vector data 
FMMV/FDMV, as selected by selector 24, is transmitted to the block-forming mode decision circuit 25. 

The block-forming mode decision circuit 25 is also supplied with output data from the field memory group 
10 and the processing mode data MPFM/MPFD from motion prediction mode decision circuit 23. The block- 

40 forming mode decision circuit 25 receives the motion prediction mode data MPFM/MPFD and the motion vector 
data FMMV/FDMV and formulates a differential picture using pictures from the frame memory group 10. The 
circuit 25 also selects, based on the difference picture, the block-forming mode most suited to the picture proc- 
essed by the DCT circuit 13. For the l-picture or l-frame, data of the picture of the frame memory group 10 
(original picture) is employed in place of the above-mentioned differential picture. 

45 it is now assumed that e.g. the macro-block of the differential picture is a macro-block shown for example 

in Figure 2. In the case of the l-picture, the macro-block is the macro-block of the original picture. In Figure 
2, odd-numbered lines o1, o2, o3, oN, where N indicates 16 in the case of a macro-block, are indicated by 
solid lines, while even-numbered lines e1, e2, e3, eN, where N indicates 16 in the case of a macro-block, 
are indicated by broken lines. The pixels of the even-numbered lines are indicated as e(i, j), while those of the 

so odd-numbered lines are indicated as o(i, j). In the differential picture or original picture, that is the picture of 
the l-picture, as shown in Figure 2, the difference EFD of the field-by-field differential picture may be repre- 
sented by the equation 1, whereas the difference EFM of the frame-by-frame differential picture may be rep- 
resented by the equation 2. 

55 

16 15 

EFD " <C - o(i+l,j)l + \eU+j) - e(i+l,j)l) ..equl 
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EBf- - e(i,j)U ggle(i.j) - o(i+l, j}l . egu 2 

5 

If a difference between the frame-by-frame difference EFM and thef ield-by-f ield difference EFD, as found 
by the equations 1 and 2, respectively, is found to be larger than a certain threshold T2 (EFM - EFD > T2), 
the block-forming mode decision circuit 25 outputs data indicating that the DCT operation by the DCT circuit 
13 be performed on the field-by-field basis, that is data MDFD for the field-by-field operation mode for the 

10 block-forming operation. Conversely, if it is found that the difference between the differences EFM and EFD 
is smaller than or equal to the threshold T2 (EFM - EFD ^@T2), the block-forming mode decision circuit out- 
puts data indicating that the DCT operation by the DCT circuit 13 be performed on the frame-by-frame basis, 
that is data MDFM for the frame-by-frame operation mode for the block-forming operation. The block-forming 
mode data MDFM/MDFD is transmitted to the address generator 11 and to the frame memory group fitted with 

15 movement compensator 20. Besides, the motion vector data (FMMV/FDMV), block-forming mode data 
(MDFM/MDFD) and the predictive mode data (MPFM/MPFD) are transmitted to the variable length encoding 
circuit 15. 

The address generator 11 controls the frame memory group 10 to output the picture data stored therein 
in the form of macro-blocks in accordance with the DCT processing mode data MDFM/MDFD. That is, if the 

20 block-forming mode data is the data MDFM indicating the frame-by-frame DCT operation, address generator 
11 controls the frame memory group to output macro-blocks in which even-numbered and odd-numbered fields 
are scanned alternately with one another. Thus the unit macro-block transmitted to DCT circuit 13 is constituted 
by the alternate even-numbered and odd-numbered fields. Conversely, if the block-forming mode data is the 
data MDFD indicating the f ield-by-f ield DCT operation, address generator 1 1 controls the frame memory group 

25 to output a macro-block in which the even-numbered field is separated from the odd-numbered field, as shown 
in Figure 4. Thus the unit macro-block, transmitted to DCT circuit 13, is constituted by the odd-numbered and 
the even-numbered fields separated from one another. However, the DCT circuit 13 performs DCT operation 
on the 8 * 8 pixel unit macro-block basis, as described previously. In Figs.3 and 4, the odd-numbered and even- 
numbered lines are indicated by solid and broken lines, respectively. 

30 On the other hand, the predictive mode data MPFM/MPFD from the movement predictive mode decision 
circuit 23, the processing mode data MDFM/MDFD from DCT mode decision circuit 25 and the motion vector 
data FMMV/FDMV, as selected by selector 24, are also transmitted to the frame memory group fitted with mo- 
tion compensator 20. Thus the frame memory group fitted with motion compensator 20 is not only responsive 
to predictive mode data MPFM/MPFD for movement prediction and to the block-forming mode data 

35 MDFM/MDFD for DCT, but also effectuates movement compensation. 

Figure 5 shows an embodiment 2 of the second high-efficiency encoding device of the present invention. 
In Figure 5, the blocks denoted by the same numerals as those in Figure 1 are operated in the same manner 
as those shown in Figure 1. Consequently, only the blocks bearing different numerals are explained. 

That is, the high efficiency encoding device shown in Figure 5 includes, besides the blocks bearing the 

40 same numerals as those of the high efficiency encoding device shown in Figure 1 , a mode decision circuit 43 
and a selector 24, as processing mode selecting means, for deciding, based on the output information from 
the movement detection means, which of the movement compensation being of the frame-by-frame predictive 
mode and the block forming for orthogonal transform being of the field-by-field operating mode or the move- 
ment compensation being of the field-by-field predictive mode and the block forming for orthogonal transform 

45 being of the frame-by-frame operating mode is more efficient and selecting the more efficient modes, and an 
address generator 31, as address generating means, for controlling the frame memory group to recognize if 
the cycle in the interlaced scanning of each frame for encoding is an odd-numbered cycle or an even-numbered 
cycle and to sequentially output odd-numbered fields for one macro-block in an amount corresponding to one 
frame at each odd-numbered cycle only if the mode of the mode decision circuit 43 is for field prediction and 

so field processing, and subsequently to output the even-numbered fields for one macro-block at each even- 
numbered cycle in an amount corresponding to one frame. 

Meanwhile, the embodiment 2 is directed to an encoding device for not separating the block-forming mode 
from the motion compensating mode. Although the same block diagram as that of the embodiment 1 suffices, 
the embodiment 2 differs fundamentally from the embodiment 1 in the above-described operation of the ad- 

55 dress generator. 

Meanwhil , the mode decision circuit 43 shown in Figure 5 (Embodim nt2)d cid s, based on data of the 
sums of the absolute values of the differences FMAD from the frame movement detection circuit 22 and data 
of the sums of th absolute values of the differences FDAD from the field motion detection circuit 21, whether 
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the mov ment prediction is to be performed on the frame-by-frame basis r on the field-by-field basis at the 
tone of the movement prediction at the frame memory group fitted with movement compensator 20 as later 

T^nTJZ^**^™?'™ PiCtUre ' USing the resulte * decision <P redicti0 " "«■• ^ta 
MPFM/MPFD of embodiment 1 ), motion vector FMMV/FDMV from the motion detection circuits 21. 22 and the 

picture from he frame memory group 10, for deciding, based on the differential picture, the mode for block- 
-J 1 k 6 ? the picture processed with DCT ^ the DCT circuit 13. That is. the mode decision 
CKCurt 43 decides wh.ch of the motion prediction being of the frame prediction mode and the block-forming 

ZSThSKiV SSi " 9 m0de PDFM ° r the m0ti0n prediction bein 9 of the f ield P^iction mode 

^11^ ?*T e bei " 9 ° f the ffeld pr0CeSSi " 9 mode PDFD fe more efficte "t- m other words, the 
mode decision circuit 43 has the combined functions of the prediction mode decision circuit 23 and the block- 
forming mode decision circuit 25. 

" ^H^^IT 66 . deCiS '° n may be a ° hieved in the same wav as the deciston of the motion prediction 
mode and the block-forming mode in the Embodiment 1 . 

^"♦h^ ° the ' hand ' address 9enerator 31 controls the frame memory group 10 to output the picture data 
stored therein in the form of macro-blocks in accordance with the aforementioned mode data PDFM/PDFD 
That is, if the block-forming mode data is the data PDFM indicating the frame-by-frame encoding operation' 

ll^T'TL" °Tt I" 6 frame mem ° ry 9r ° UP 10 to ° Utput mac ~-hlocks in which scanning of even^ 
numbered and odd-numbered lines is alternated with one another. Thus the unit macro-block transmitted to 
DCT circuit 13 is constituted by the alternate even-numbered and odd-numbered fields. Conversely if the 

3 Tco"nCJtr f ^ fe ^ PDFD indiCatin9 the ' ield " by - f i6ld enCOdin9 °P eration . add ««* generator 
HZ ^? t / haframe K memor y 9 ro "P to output odd-numbered fields for the macro-block sequentially for one 
frameatthe odd-numbered cyclesand subsequently output even-numbered fields for the macro-block sequen- 
,^° ne ^ me at the even-numbered cycles. Thus the unit macro-block, transmitted to DCT circuit 13 at 
1„h^m Cy ' 18 COns,ituted sole| y bv 'he odd-numbered fields during the odd-numbered cycles 

SlSSr* ♦! 6V f n -. numb ! red f i6ldS duri " 9 the eve "-"^hered cycles. However, the DCT circuit 1 3 effec- 
tuates DCT on the basis of the 8 . 8 pixel unit macro-blocks, as described previously 

na J^df? fh" """J ^ above - described efficiency encoding device for information sig- 

E£ZZ22i 6 fST2!? tad emb0diments 1 and 2 ' to make a ^angeover between the frame pre- 
t^T^t r ,! Pred,Ct '° n m0d6 th6 movement P red ^on and between the frame processing 

Zt hf 2h- h P-^ess-ng mode in the block-forming, for DCT. on the macro-block basis, the encoding 
may be achieved most efficiently on the macro-block basis. 

lf ,Can l' ? 8 T'?," prediction and DCT as described hereinbelow is effectuated by the encoding de- 
vice of the embodiments 1 or 2 depending on the formats of e.g. the so-called digital VTR 

odd 'ISLVS 1 ,l th ,V ie,dS , making UP 8 frame ° f the '■ frame " '- pichire are indicated as '0 field (an 
f' eld °f 'he '-frame) and le field (even-numbered field of the l-frame). the fields making up he 

m ^Z r J, Z'Tt a o 6 <' IC f ^ 38 P ° fie ' d (a " odd - numb e« d «eld of the P-frame) and Pe field (even- 
numbered field of the P-frame). and the fields making up the B-frame or B-picture are indicated as Bo field 
(an odd-numbered field of the B-frame) and Be field (even-numbered field of the B-frame) 

in JtZZT^!** ^ SSing m0de f ° r b ' 0Ck f0rmati ° n aCCOrdin9 to the embodiments 1 and 2 is that 
m wfuch the odd-numbered f ,elds and the even-numbered fields are combined to form the macro-block which 
« used as a process^ unit That is. the frame processing mode is that of forming a macro-block for each 

f2?"-2!»h H ' d processi "9 mode for block for ™tion is that in which the odd-numbered 

fields and the even-numbered fields each form macro-blocks which are used as processing units. That is. the 

i^.!T^r 9 18 ° f f ° rming 8 macro - block for e ech field. Consequentiy. with the l-frame. for ex- 
ample, the frame processing mode is changed over from the frame processing mode to the field processing 
mode or vice versa for each macro-block. a 
Besides, with the high efficiency encoding device according to the embodiments 1 and 2. each frame is 
AnrKM^' a ^jpn9 as the encoding operation is concerned, into odd-numbered cycles and even-numbered cycles, 
« 22g resp^ilely 6 ° f SCanning ° f odd - numbered and even-numbered cycles of the interlaced 

ma^hi"*! 1 • 6 ' W *!f n hand [ in9 the so-oalied 4:2:0 component digital VTR format with the embodiment 1 , each 
ev^'uSlT t UP 0 l ,um,nan ^ blocks Y0 ' VI. Y2 and Y3. each composed of odd-numbered fields and 
fhTbZfnr^n t a " d /^jP'"' difference blocks CbO and CM, each composed of odd-numbered fields, if 
un?t h^ t lT h 9 l8 J h !, frarne P rocessi "9 mode, and DCT is performed based on the above-mentioned 
unit blocks of the macro-block, as shown in Figure 7. Conversely, if the block forming mode is the field proc- 
essing mode each macro-block MB is made up of luminance blocks Y02o, Y13o composed of the odd-num- 

rT^? Y ° 2 • V13e 6aCh C ° mpOSed ° f th eva "-n^bered fields and colour difference 
blocks CbO, Cr1 each composed of odd-numbered fields, and DCT is performed bas d on the above- 
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mentioned unit blocks of th macro-block. 

As for the motion prediction for the embodiment of Figure 7, motion prediction MCP between the l-frame 
and the P-frame is possible for the frame predictive mode, as shown in Figure 8. On the other hand motion 
prediction MCoPo betw en the lo field and the Po field, motion prediction MCoPe between the I field and 
the Pe field and motion prediction MCePe betw en the le field and the Pe field become possible for th field 
prediction mode. That is, in Figure 8, motion prediction and block formation may be present independently for 
the frame pred.ction/processing mode and for the field prediction/processing mode, such that a motion vector 
may be found for the frame prediction mode and two motion vectors may be found for the field prediction mode 

Consequently, if, in the above-described embodiment 1 , the block-forming mode of the l-frame is the frame 
processing mode, the lo fields and the le fields are combined forthe odd-numbered cycles to form the macro- 
block. Dunng the odd-numbered cycles. DOT. quantization and variable length encoding are performed from 
one macro-block to another. Conversely, no data is transmitted during the even-numbered cycles for the pres- 
ent mode. Meanwhile, DCT is performed for the above-mentioned 8 « 8 unit blocks. 

If the block-forming mode is the field processing mode, the macro-block is constituted by an lo field and 
an le field, separated from each other, for the odd-numbered cycle, and DCT, quantization and variable length 
encoding are performed from one macro-block to another. Conversely, no data is transmitted during the even- 
numbered cycles, as shown in Figure 7. Meanwhile, DCT is performed for the above-mentioned 8 . 8 unit 
blocks. 

For the P-frame, the following operation is performed. If, for example, the block formation mode of the P- 
frame is the frame processing mode and the motion prediction mode is the frame prediction mode, the frame- 
to-frame motion vector MVP is detected during the odd-numbered cycles, using the forwarxJ picture (l-frame 
picture) as the reference picture. The macro-block, composed of alternate lo and le fields, is used as a pre- 
diction picture, and the difference thereof from the original picture is encoded. Conversely, no data is trans- 
mitted dunng the even-numbered cycles for the present mode. 

If the block-forming mode for the P frame is the frame processing mode, with the motion prediction being 
of the field prediction mode, the motion vector MVoPo between the lo field and the Po field, the motion vector 
MVePo between the le field and the Po field, the motion vector MVoPe between the lo field and the Pe field 
and the motion vector MVePe between the le field and the Pe field are detected, using the lo field and the 
Pe field (or the Po field and the Pe field) as the reference pictures, for the odd-numbered cycles. The one of 
the prediction forthe odd-numbered cycles, the prediction for the even-numbered cycles and both predictions 
such as a mean value of the prediction for the odd-numbered field and the od-numbered field, which will give 
the least value of the predicted errorfrom the current frame P, is selected, and the difference from the original 
picture is found, using the above-mentioned macro-block, combined from the lo and le fields, as the reference 
picture. Conversely, no data is transmitted for the even-numbered cycles of the current mode 

If the block-forming mode for the P-frame is the field processing mode, with the motion prediction being 
of the frame prediction mode, the frame-to-frame motion vector MVP is detected for the odd-numbered cycles 
using the l-frame picture or the P-frame picture as a reference picture, and the difference from the original 
picture (wh.ch is a macro-block constituted by Po an Pe fields) is encoded, using the above-mentioned macro- 
block, constituted by the lo and le fields separated from one another, as a prediction picture. Conversely no 
data is transmitted for the even-numbered cycles of the current mode, in the same manner as above 

If the block-forming mode for the P frame is the field processing mode, with the motion prediction being 
erf the field prediction mode, the motion vector MVoPo between the lo field and the Po field, the motion vector 
MVePo between the le field and the Po field, the motion vector MVoPe between the lo field and the Pe field 
and the motion vector MVePe between the le field and the Pe field are detected, using the lo field and the le 
field (or the Po field and the Pe field) as the reference pictures, for the odd-numbered cycles. The one of the 
prediction for the odd-numbered cycles, the prediction for the even-numbered cycles and both predictions 
such as a mean value of the prediction for the odd-numbered field and that for the odd-numbered field which 
will give the least value of the predicted error from the current frame P, is selected, and the different from 
the onginal picture, which is the macro-block combined from the Po and Pe fields, separated from each other 
is encoded, using the macro-block, combined from the lo and le fields, separated from each other, as the ref- 
erence picture. Conversely, no data is transmitted forthe even-numbered cycles of the current mode 
If the current frame is the B-frame. the following operation is performed. 

If the block-forming mode forthe B-frame is the frame processing mode, with the motion prediction being 
of the frame prediction mode, the frame-to-frame motion vectors, that is a motion vector FMVB between the 
l-frame and the B-frame and a motion vector BMVB between the P-frame and the B-frame. are detected for 
the odd-numbered cycle, using th temp rally f rward and backward pictures as the reference pictures that 
one of the forward prediction, backward prediction and bidirectional prediction, which is a mean value between 
the two predictions, which will give the last value of the stimated error from the current frame, is selected. 
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and the difference from the original picture is encoded, using the macro-block, composed of alternate odd- 
numbered and even-numbered fields, as the prediction picture. Conversely, no data is transmitted for the even- 
numbered cycles of the current mode, in the same manner as above. 

If the block-forming mode for the B frame is th frame processing mod , with the motion prediction being 

5 of the f i Id prediction mode, the temporally forward and backward pictures are us d for the odd-numb red 
cycles as the reference pictures, and prediction is made of the respective odd-numbered fields and the even- 
numbered fields. The respective motion vectors, namely a motion vector FMVoBo between the lo field and 
the Bo field, a motion vector FMVeBo between the le field and the Bo field, a motion vector FMVoBe between 
the lo field and the Be field, a motion vector FMVeBe between the le field and the Be field, a motion vector 

10 BMVoBo between the Po field and the Bo field, a motion vector BMVeBo between the Pe field and the Bo 
field, a motion vector BMVoBe between the Po field and the Be field and a motion vector BMVeBe between 
the Pe field and the Be field are detected. The one of the prediction for the odd-numbered field, the prediction 
for the even-numbered field, and both predictions, for example, a mean value of the two predictions, by the 
respective vectors, which will give the least value of the predicted error from the current frame, is selected, 

15 and the difference from the original picture is encoded, using the macro-block, composed of the lo and le fields 
or Po and Pe fields, as the prediction picture. Conversely, no data is transmitted for the even-numbered cycles 
of the current mode. 

If the block-forming mode for the B frame is the field processing mode, with the motion prediction being 
of the frame prediction mode, frame-to-frame motion vectors, namely a motion vector FMVB between the I- 

20 frame and the B-frame and a motion vector BMVB between the P-frame and the B-frame, are detected, for 
the odd-numbered cycles, using the temporally forward and backward pictures as reference pictures. The one 
of the forward prediction, backward prediction and bidirectional prediction, which is a mean value between the 
two predictions, which will give the least value of the predicted error from the current frame, is selected, and 
the difference from the original picture is encoded, using the above-mentioned macro-block, composed of odd- 

25 numbered and even-numbered f ields, separated from one another, as a prediction picture. Conversely, no data 
is transmitted for the even-numbered cycles of the current mode. 

If the block-forming mode for the B frame is the frame processing mode, with the motion prediction being 
of the field prediction mode, the temporally forward and backward pictures are used for the odd-numbered 
cycles as the reference pictures, and prediction is made of the respective odd-numbered fields and the even- 
so numbered fields. The respective motion vectors, namely a motion vector FMVoBo between the lo field and 
the Bo field, a motion vector FMVeBo between the le field and the Bo field, a motion vector FMVoBe between 
the lo field and the Be field, a motion vector FMVeBe between the le field and the Be field, a motion vector 
BMVoBo between the Po field and the Bo field, a motion vector BMVeBo between the Pe field and the Bo 
field, a motion vector BMVoBe between the Po field and the Be field and a motion vector BMVeBe between 

35 the Pe field and the Be field are detected. The one of the prediction for the odd-numbered field, the prediction 
for the even-numbered field, and both predictions, for example, a mean value of the two predictions, by the 
respective vectors, which will give the least value of the predicted error from the current frame, is selected, 
and the difference from the original picture is encoded, using the macro-block, composed of the lo and le fields 
or Po and Pe fields, as the prediction picture. Conversely, no data is transmitted for the even-numbered cycles 

40 of the current mode. 

However, with the embodiment 1, motion prediction between lo and le fields, motion prediction between 
Po and Pe fields or motion prediction between lo and le fields or motion prediction between Bo and Be fields 
cannot be achieved, as may be seen from Figure 8. 

In such case, prediction from an odd-numbered field to an even-numbered field may be made in each pic- 

45 ture by employing the embodiment 2. If the block-forming is of the frame processing mode, each of unit blocks 
of a macro-block MB, namely luminance blocks YO, Y1 , Y2 and Y3, each composed of odd-numbered and even- 
numbered fields, and colour difference blocks CbO, Cr1, each composed of odd-numbered fields, is processed 
with DCT for the odd-numbered blocks, as shown for example in Figure 9. If the block forming mode is the 
field processing mode, each of the unit blocks, that is the luminance blocks Y02o, Y13o of the odd-numbered 

so field and the colour difference blocks CbO, Cr1 of the odd-numbered field, is processed with DCT for the odd- 
numbered cycles. Subsequently, the luminance blocks Y02e and Y13e of the odd-numbered fields are proc- 
essed with DCT during the even-numbered cycles. 

With the present example, shown in Figure 9, motion prediction SMCI between the lo and le fields and 
motion prediction SMCP between the Po and Pe fields may be made in addition to the motion predictions MVP, 

55 MCoPo, MCoPe, MCePo and MCePe shown in Figure 9. 

Thus, in the embodiment 2, if the block f rming mode for the l-frame is th frame processing mode, the 
lo and le fields are combined for the odd-numbered cycles to form the macro-block and, for the odd-numbered 
cycles, for exampl , DCT, quantization and variable length encoding are performed from one macro-block to 
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another. It is not d that DCT is performed on the above-mentioned 8 ♦ 8 unit block basis. Convers ly, no data 
is transmitted during the even-numbered cycles for the current mode. If the block-forming mode is the field 
processing mode, only odd-numbered fields of the macro-block are encoded in a similar manner for the odd- 
numbered cycles. In this mann r, at a time point of completion of the odd-numbered cycle, th lo field in its 
entirety and a macro-block fraction of the le field by the frame processing mode are obtained at the decod r 
as later explained. For the even-numbered cycle of the l-frame. motion prediction is performed of the macro- 
block of the le field by the field processing mode, using the lo field as a reference picture, and the motion 
vector SMVI as well as the difference from the prediction picture is encoded. 

If the currentframe is the P-frame, thefollowing operation is performed. If, for example, the block-forming 
mode for the P-frame is the frame processing mode and motion prediction is of the frame prediction mode 
the frame-to-frame motion vector MVP is detected, using the forwardpicture (l-frame picture) as a reference 
picture, for the odd-numbered cycles, and a difference from the original picture is encoded, using the macro- 
block composed of lo and le fields as a prediction picture. No data is transmitted for the even-numbered cycles 
for the current mode, in the same manner as above. 

If the block-forming mode is of the field processing mode, with the motion prediction being of the field 
prediction mode, a motion vector MVoPo between the lo field and the Po field and a motion vector MVePo 
between the le field and the Po field are detected, for the odd-numbered cycles, using the lo and le fields or 
the Po and Pe fields as reference pictures. The one of the prediction for the odd-numbered fields, prediction 
for the even-numbered fields and both predictions, for example, a mean value of the prediction for the even- 
numbered fields and that for the odd-numbered fields, is selected, and the difference thereof from the pre- 
diction picture is encoded. For the even-numbered cycles of the current mode, the motion vector MVoPe be- 
tween the lo and Pe fields, the motion vector MVePe between the le and Pe fields and the motion vector SMVP 
between the Po and Pe fields are detected for the macro-block of the field processing mode The one of the 
prediction for the odd-numbered fields, the prediction for the even-numbered fields and the prediction for the 
odd-numbered fields of the current frame (motion prediction from Po field concerned only with the even- 
numbered cycles) by the respective vectors and the prediction which is a mean value between two of the 
above-mentioned predictions, which will give the least value of the predicted error, is selected, and the differ- 
ence thereof from the prediction picture is encoded. 

If the block-forming mode for the B-frame is the frame processing mode, and motion prediction mode is 
the frame prediction mode, frame-to-frame motion vectors, that is a motion vector FMVB between the l-frame 
and the B-frame and a motion vector BMVB between the P-frame and the B-frame. are detected for the odd- 
numbered cycles, using forward and backward pictures as reference pictures. The one of the forward predic- 
tion, backward prediction and bidirectional prediction, that is a mean value between forward and backward pre- 
dictions, which will give the least value of the predicted error from the current frame, is selected, and the dif- 
ference of the selected prediction from the current picture is encoded. Conversely, no data is transmitted for 
the even-numbered cycles for the current mode. 

If the block-forming mode is the field processing mode, with the motion prediction being of the field pre- 
diction mode, prediction of odd-numbered and even-numbered fields of the forward and backward pictures as 
the reference pictures is performed for the odd-numbered cycles, and respective motion vectore, namely a 
motion vector FMVoBo between the lo and Bo fields, a motion vector FMVeBo between the le nd Bo fields a 
motion vector BMVoBo between the Po and Bo fields and a motion vector BMVeBo between the Pe and Bo 
fields are detected. The prediction which will give the least value of the predicted error is selected in the same 
manner as before and the difference of the selected prediction and the predicted picture is encoded For the 
even-numbered cycles of the current mode, predictions by the motion vector FMVoBe between the lo and Be 
fields, motion vector FMVeBe between the le and Be fields, motion vector BMVoBe between the Po and Be 
fields and the motion vector BMVeBe between the Pe and Be fields and prediction of the odd-numbered fields 
of the current frame, that is the prediction by the motion vector SMVB between the Bo and Be fields are ad- 
ditionally performed, and such a prediction which will give the least prediction error is selected. A difference 
is then taken of the selected prediction from the predicted picture. 

When handling the so-called 4:2:2 component digital VTR format with the above-described embodiment 
1. the unit blocks of the macro-block, that is the luminance blocks YO, Y1 . Y2 and Y3. each composed of odd- 
numbered and even-numbered fields, and t he colour difference blocks Cb01 , Cr01 , Cb23 and Cr23, each com- 
posed of odd-numbered and even-numbered blocks, are processed with DCT. 

For the field processing mode, the luminance blocks Y02o and Y13o of the odd-numbered fields colour 
difference blocks Cb0123o and Cr0123o of the odd-numbered fields, the luminance blocks Y02e and Y13e of 
the even-numbered fields and colour difference bl cks Cb0123e and Cr0123e of the even-numbered fields 
are processed with DCT. 

Motion prediction for the example of Figure 11 is performed in a manner as shown in Figure 8. However, 
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with the present example, shown in Figure 11, motion prediction between lo and le fields, motion prediction 
between Po and Pe fields or motion prediction between Bo and Be fields cannot be achieved, in the same 
manner as above. 

In such case, the embodiment 2 may be employed, as explained previously. If th block-forming is of the 
5 frame processing mode, the unit blocks of a macro-block, namely the luminance blocks YO, Y1, Y2 and Y3 
and colour difference blocks Cb01, Cr01, Cb23 and Cr23, each composed of odd-numbered and even- 
numbered fields, are processed with DCT for the odd-numbered blocks, as shown for example in Figure 12. 
If the block forming mode is the field processing mode, respective unit blocks, that is the luminance blocks 
Y02o, Y13o composed of the od-numbered fields and the colour difference blocks Cb0123o and Cr0123o corn- 
to posed of the odd-numbered fields are processed with DCT for the odd-numbered cycles. Subsequently, the 
luminance blocks Y02e and Y1 3e of the even-numbered f ields and the colour difference blocks Cb0123e and 
Cr0123e composed of the even-numbered fields are processed with DCT for the even-number cycles. 
Motion prediction for the example of Figure 12 is the same as that shown in Figure 12. 
For handling the above-mentioned 4:2:2 component digital VTR format by the above-described embodi- 
es ments 1 and 2, an arrangement may be so made that, besides the operation shown in Figs. 11 and 12, frame 
movement prediction is performed on the basis of the macro-block MB, as shown in Figure 13, whereas, for 
field motion prediction, a certain macro-block MB(i, j) and another macro-block MB(i+1, j) therebelow are 
grouped as a macro-block set MBg and motion prediction for the odd-numbered fields and the motion prediction 
for the even-numbered fields are performed of the macro-block set MBg. 
20 Figure 14 shows several macro-blocks of the frame shown partially in Figure 13. It is assumed that the 
operation proceeds in a direction shown by arrow in Figure 14. That is, Figure 14 shows a macro-block MB(i, 
j+1) next to the macro-block MB(i, j), and macro-blocks. MB(i+1, j) and MB(i+1, j+1) therebelow, that is, be- 
longing to the next line. 

In the macro- block shown in Figure 14, the luminance blocks YO, Y1 and the col our difference blocks Cb01, 

25 Cr01 are processed with DCT, with e.g. the frame processing mode, for each of the macro-blocks MB(i, j), MB(i, 
j+1) MB(i+1, j) and MB(i+1, j+1). Consequently, with the frame processing mode, processing of each macro- 
block is not affected by the processing of other macro-blocks. 

Conversely, with the f ield processing mode, as shown in Figure 1 5, the macro-blocks making up the mac- 
ro-block set MBg are divided into macro-blocks MBgo of odd-numbered fields and macro-blocks MBge of even- 

30 numbered fields and luminance blocks YOo, Y1o and colour difference blocks Cb01o, Cr01o within the odd- 
field macro-block MBgo are processed with DCT. If the macro-block set MBg is made up of the macro-blocks 
MB(i, j) and MB(i+1, j) of Figure 14, the luminance blocks YOo, Y1o within the odd-field macro-block MBgo in 
the macro-block MBg are made up of odd-field luminance blocks of the macro-block MB(i, j) and odd-field lu- 
minance blocks of the macro-block MB(i+1, j) and the colour difference blocks Cb01o, Cr01o within the odd- 

35 field macro-block MBgo are made up of odd-field colour difference blocks of the macro-block MB(i, j) and odd- 
field colour difference blocks of the macro-block MB(i+1, j). Similarly, the luminance blocks YOo, Y1o within 
the even-field macro-block MBge in the macro-block MBg are made up of even-field luminance blocks of the 
macro-block MB(i, j) and even-field luminance blocks of the macro-block MB(i+1 , j) and the colour difference 
blocks CbOle, Cr01e within the even-field macro-block MBge are made up of even-field colour difference 

40 blocks of the macro-block MB(i, j) and even-field colour difference blocks of the macro-block MB(i+1 , j). 

As may be seen from above, the relation between motion prediction and DCT processing modes is as fol- 
lows: In the present encoding device, if, in the macro-block MB(i, j), the motion prediction is of the frame proc- 
essing mode and the DCT is of the frame processing mode, the difference between the predicted picture and 
an input picture (original picture), extracted from a picture decoded in the frame memory group fitted with mo- 

45 tion compensator 20 as a reference frame, is processed with DCT. The DCT coefficients and frame motion 
vectors are transmitted. 

If, in the macro-block MB(i, j), the motion prediction is of the field processing mode and the DCT is of the 
field processing mode, the difference between the predicted picture extracted from the odd-numbered field 
and the odd-field original picture and the odd-field motion vector are encoded for the macro-block MB(i, j), 
50 while the difference between the predicted picture extracted from the even-numbered field and the even-field 
original picture and the even-field motion vector are encoded for the macro-block MB(i+1, j). 

If, in the macro-block MB(i, j), the motion prediction is of the field processing mode and the DCT is of the 
frame processing mode, a frame difference between a predicted picture for the position of the macro-block 
MB(i, j) taken out from the reference frame and the input picture, the odd-field motion vector and the even- 
55 field motion vector are transmitted for the macro-block MB(i, j). A frame difference between a predicted picture 
for the position of the macro-block MB(i+1,j)tak n ut from the r ferenc frame and the input picture is trans- 
mitted for the macro-block MB(i+1 , j). 

If, in the macro-block MB(i, j), the motion prediction is of the frame processing mode and the DCT is of 
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the f i Id processing mode, a difference between a predicted picture taken out from the odd-numbered field 
and the odd-field original picture, the frame motion vector of the macro-block MB(i, j) and the frame motion 
vector of the macro-block MB(i+1 , j) are transmitted for the macro-block MB(i, j), while the difference between 
the odd-numb red predicted picture and the input picture is transmitted for the macro-block MB(i+1 , j). 

Meanwhile, with the encoding d vice of the present embodiment, the present code is realized by adding 
extension bits to the conventional macro-block type for interchangeability with the conventional system. 

That is. in the embodiment 1 , the macro-block type has three predictions, namely forward prediction, back- 
ward prediction and bidirectional prediction. Since prediction from odd-numbered and even-numbered fields 
of the previous frame are possible with the forward prediction, the present code is realized by appending ex- 
tension bits useful for recognizing which of these predictions is used. Since there are two predictions, it suffices 
to add one bit for one direction, that is for the forward or backward direction. For example, if the prediction is 
forward or backward prediction and from the odd-numbered fields, it suffices to add a code 1 as an extension 
bit to the conventional macro-bit type. Similarly, if the prediction is from the even-numbered field, it suffices 
to add a code 0 as an extension bit to the conventional macro-bit type. For bidirectional prediction, both ex- 
tension bits are appended for both forward and backward predictions. 

Meanwhile, for a frame prediction mode, no extension bits are appended, so that the bit string is of the 
same style as the conventional bit stream (MPEG). 

The above applies to the P-frame as well. 

In the embodiment 2, the macro-block type has three predictions, namely forward prediction, backwaid 
prediction and bidirectional prediction for e.g.the B-frame. If the prediction is the forward prediction with the 
field prediction mode, it is necessary to append extension bits to the macro-block for allowing to recognize if 
when the prediction is for the field prediction mode, the prediction is thatfrom an odd-numbered field, an even- 
numbered field or from an odd-numbered field of the current frame. That is, since there is a prediction from 
the current frame in the forward field prediction mode, one or two extension bits are required for expressing 
three predictions including odd- and even-numbered predictions by extension bits. On the other hand, for back- 
ward field prediction mode, since there are two predictions, that is prediction for odd and even numbers 1 ex- 
tension bit is required. For example, for forward prediction, a code 1 for odd-odd-numbered field of a forward 
frame and, a code 01 for even-numbered field of a forward frame and a code 11 for prediction from odd-num- 
bered field of a rear frame are appended. For backward prediction, it suffices to append codes 1 and 0 for pre- 
diction from an odd-numbered field of a backward frame and for prediction from an even-numbered field of a 
backward frame to the conventional macro-bit type. 

If the mode is the frame prediction mode, no extension bits are appended, so that the bit string is of the 
samestyle as the conventional bit stream (MPEG). For bidirectional prediction, both extension bits are append- 
ed for forward or backward prediction. 

The above applies to the P-frame as well. 

As a modification, the number of the extension bits can be reduced to one for forward prediction That is 
in the even-numbered cycle for the field prediction mode, the number of bits may be reduced to two and the 
forward prediction mode may be transmitted by one extension bit by abolishing prediction from the odd-num- 
bered field furthest removed both temporally and spatially, as shown in Figure 16. Specifically, for odd-num- 
bered cycles and for forward prediction, it suffices to add codes 1 and 0 to the conventional macro-block type 
as extension bits in the case of prediction from an odd-numbered field of the forward frame and an even- 
numbered field of the forward frame. Similarly, for even-numbered cycles and for forward prediction, it suffices 
to add codes 1 and 0 to the conventional macro-block type as extension bits in the case of prediction from an 
odd-numbered field of the current frame and an even-numbered field of the forward frame. Finally, for back- 
ward prediction, it suffices to add codes 1 and 0 to the conventional macro-block type as extension bits in the 
case of prediction from an odd-numbered field of the backward frame and an even-numbered field of the back- 
ward frame. 

The block diagram of Figure 17 shows a decoder (first and second decoding units) for picture signals as 
a counterpart device of the encoding device of the above described embodiments 1 and 2. The high efficiency 
decoder includes a variable length encoding circuit 51 for receiving and decoding coded data of a picture to 
be reproduced and the header information for outputting the detected motion vector information, the motion 
prediction mode information indicating which of the frame-by-frame motion compensation and the field-by-field 
motion compensation in a macro-block is more efficient, the block-forming mode information indicating which 
of the block formation for frame-by-frame orthogonal transform and block formation for frame-by-frame or- 
thogonal transform in a macro-block is more efficient, and a macro-block address increment in the macro-block 
header information. The high eff ici ncy decod r also includes address generators 81 , 82 and 83 by calculating 
address increment values at frame buffers 61 , 62 and 64 storing picture decoding data from th macro-address 
increment for finding leading addresses of th macro-blocks and supplying the I ading addresses to the frame 
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buffers 61, 62 and 64, and motion compensation circuits 59, 60, 63, 65 and 66 for supplying the relativ ad- 
dresses of the macro-blocks other than the leading addresses to the frame buffers 61 , 62 and 64 for data ac- 
cessing, receiving the detected motion vectors, motion prediction mode information and the block-forming 
mode information, xecuting the compensation betwe n motion-compensated frames or fields in association 
with the mod information and transmitting the motion-compensated picture information to the frame buffere 
61, 62 and 64. 

Referring to Figure 17, data encoded by the high efficiency encoding device of the embodiments 1 and 2 
are transiently recorded on a storage medium, such as CD. The encoded data reproduced form CD is supplied 
via input terminal 50 to an inverse variable length encoding circuit 51 where the header information etc are 
decoded from one sequence to another, from one frame group to another and from one frame to another. The 
header information is decoded from one slice (macro-block group) to another. The quantization width is includ- 
ed in the slice header. The macro-block type indicating the macro-block addresses, frame processing 
mode/field processing mode and the decoding system is decoded from one macro-block to another. The quan- 
tization width is decoded at the time of the updating. 

Meanwhile, if the block formation in a macro-block is of the frame processing mode, the macro-block in 
its entirety is decoded for the odd-numbered cycle, while no data is decoded for an even-numbered cycle If 
the block formation in a macro-block is of the field processing mode, only the block including odd-numbered 
fields in the macro-block is decoded for the odd-numbered cycle, wile the block including even-numbered fields 
is decoded for the even-numbered cycles. 

The picture information is decoded by a dequantizer 53 performing an operation which is the reverse of 
quantization and an inverse DCT circuit 54 performing an inverse DCT operation, and a decision is given by 
the macro-block type as to whether or not the information is a differential information. Depending on the results 
of decision, a mode switch 57 for changeover between addition or non-addition to the reference picture (or 
between non-intra/intra of MPEG coding) by an additive node 56. The decoded picture is entered to frame buf- 
fers 64 or 61 for the l-or P-frame (alternately each time the l-frame or the P-frame s processed) and to frame 
buffer 62 if the current frame is the B-frame. Each frame buffer is composed of two field buffere and the odd- 
/even field picture is stored separately in each of these field buffers. Recording in the frame buffere is controlled 
by changing over a switch 58. 

The addresses recorded in the frame buffer are supplied from an address generator. The address generator 
calculates an address increment value in the frame bufferfrom the macro-block address increment in the head- 
er information of the macro-block to find the leading address of each macro-block. 

The quantization width data is stored in a one-field memory 52. The quantization width data is supplied 
to dequantizer 53 via switch 55 changed over depending on t he output of the inverse variable length encoding 
circuit 51. Since only the macro-block processed with the field processing mode is decoded for the even- 
numbered cycles, macro-block addresses decoded for each macro-block, macro-block type and the motion 
vector required by the prediction system indicated thereby are decoded and the differential picture from the 
reference field is added to the motion-compensated picture to produce the playback picture. 

In the case of an encoding system in which the even-field quantization width data are transmitted inde- 
pendently of the odd-numbered field for the even-numbered cycle, it is unnecessary to store the quantization 
width data transmitted for the odd-numbered cycle, so that the one-field memory 52 may be eliminated 

On the other hand, data of the frame buffere 64, 62 and 61 is motion-compensated by the motion com- 
pensation circuits 65, 66, 59, 60 and 63. Atthis time, the respective motion compensation circuits change over 
the frame motion compensation/field motion compensation (frame/field) depending on the block-forminq mode 
at the time of the DCT operation. ~ 

These motion-compensated pictures are transmitted to respective fixed terminals of changeover switches 
67, 68 and 71 . These changeover switches 67, 68, 71 are changed over for taking out the reference field or 
frame indicated by a decoding system of the macro-block decoding type. The changeover switch 71 is supplied 
with an output of switch 67 and a signal which is outputs of the changeover switches 67 and 68 added together 
by additive node 69 and subsequently halved by a divider 70. An output of switch 71 is supplied to switch 57 

Outputs of frame buffers 64. 61 ad 62 are supplied via changeover switch 72 to a display 73. The display 
71 is supplied with the outputs of the changeover switch 72 which are changed over in the sequence of play- 
back pictures instead of in the decoding sequence for producing an output picture. 

It will be seen from above that, if there is a moving object CA ahead of the stationary background, as shown 
in Figure 46, the moving object is seen as being zig-zag shaped, as shown at KS, if one frame is viewed be- 
cause there is a movement between fields. With the device of the present embodiment, since the moving ob- 
ject is encod d with the field processing mode, it can be processed as a picture d void of deviations so that 
a high-quality moving picture may be reproduced by odd/even motion compensation. Thus, as shown for x- 
ample in Figure 18, the moving portion is processed with the field processing mode during odd-numbered cy- 
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unit. 

That is, the high eff iciency encoding device of the embodiment 4 includes, for encoding a moving picture 
having a frame made up of two frames, encoding means for dividing each of the blocks in the frame into an 
odd field (first field) and an even field (second field) for rendering the motion pr diction of the first to second 
fields possible (first limitation mode) f r changing over between first and s cond field division/first and second 
field non-division on th macro-block basis by way of block formation (second limitation mode). These encoding 
means are changed over from frame to frame. A 1-bit information indicating these encoding means, that is the 
information indicating the selected mode, is appended to the codes. 

Referring to the drawings, the embodiments 3 and 4 are explained in detail. 

Figure 20 shows a third high efficiency encoding device for picture signals according to the embodiment 
3 of the present invention. With the present encoding device, encoding is performed on the basis of macro- 
blocks each consisting in a two-dimensional array of plural pixels smaller in size than a picture. For example, 
each macro-block consists of 1 6 * 1 6 pixels in a spatial array of input picture data in a raster scanning sequence. 

The high efficiency encoding device of the embodiment 3 includes a frame memory group 10 for storing, 
as an original picture, a frame (picture) consisting of plural unit blocks (macro-blocks) each consisting of 16 ♦ 
16 pixels, and motion detection means made up of a frame motion detection circuit 22 as means for detecting 
the sum of absolute values of the pixels and motion vectors between the frames on the macro-block basis, 
and a field motion detection circuit 21 for detecting on the macro-block basis, the sum of absolute values of 
the pixels and motion vectors between the fields, made up of even-numbered and odd-numbered scanning 
lines of the frame pixels. 

The device of the present embodiment also includes a frame/field mode decision circuit 33 made up of 
first mode selecting means and second mode selecting means. The first mode selecting means decides which 
of a frame prediction mode of carrying out motion compensation based on a frame in the macro-block or a 
field prediction mode of carrying out motion compensation based on a field in the macro-block is more efficient 
and selects the more efficient mode. The second mode selecting means decides which of a frame processing 
mode of forming blocks for carrying out orthogonal transform, such as DCT, based on frame in the macro- 
block, of a field processing mode of forming blocks for carrying out orthogonal transform, such as DCT, based 
on of a field in the macro-block is more efficient for carrying out orthogonal transform, using the output infor- 
mation of the motion detection means and the first mode selecting means. 

Besides, the present embodiment 3 includes, in addition to the motion detection means and the frame/field 
mode decision circuit 33, a limitation mode decision circuit 34(a), as limitation mode selecting means, for de- 
ciding which of the second limitation mode of adaptively changing over the mode of block formation for ortho- 
gonal transform between the frame processing mode and the field processing mode on the basis of each mac- 
ro-block in each frame for encoding each macro-block in accordance with the selected mode or the first lim- 
itation mode of forming the blocks for orthogonal transform of the entire macro-blocks in each frame in accor- 
dance with the field processing mode, encoding odd fields in the macro-blocks in an amount corresponding 
to one frame during odd-numbered cycles and encoding even fields in the macro-blocks in an amount corre- 
sponding to one frame during even-numbered cycles is more efficient for encoding and selecting the more ef- 
ficient limitation mode. The odd-numbered and even-numbered cycles mean the periods of scanning of odd- 
numbered and even-numbered fields in interlaced scanning, respectively. 

Meanwhile, the decision circuit 34(b) of the fourth encoding device shown in Figure 21 includes limitation 
mode selecting means for deciding which of the second limitation mode of adaptively changing over the mode 
of block formation for orthogonal transform between the frame processing mode and the field processing mode 
on the basis of each macro-block in each frame for encoding each macro-block in accordance with the selected 
mode or the first limitation mode of forming the blocks for orthogonal transform of the entire macro-blocks in 
each slice in accordance with the field processing mode, encoding odd fields in the macro-blocks in an amount 
corresponding to one frame during odd-numbered cycles and encoding even fields in the macro-blocks in an 
amount corresponding to one frame during even-numbered cycles is more efficient for encoding and selecting 
the more efficient limitation mode. The odd-numbered and even-numbered cycles mean the periods of scan- 
ning of odd-numbered and even-numbered fields in interlaced scanning, respectively. 

Figure 42 shows a modification of limitation mode selecting means of the embodiment 3. With the third 
encoding device, data FDAD and FMAD, as found from macro-block to macro-block, are cumulated from frame 
to frame to find cumulated data SFDAD and SFMAD. When the cumulative data SFDAD becomes smaller than 
FMAD + T, T b ing an offset value, the second limitation mode is selected, and otherwise, the first limitation 
mode is selected. 

Besides, with th third encoding devic , data FDAD and FMAD, as found from macro-block to macro-block, 
are cumulated from slic to slice to find cumulated data SFDAD and SFMAD. When the cumulative data SFDAD 
becomes smaller than FMAD + T, T being an offe t value, the s cond limitation mod is selected, and other- 
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r,tl • ?k T TT m ° de iS S ,eCted Similar,y ' 8 f IOW Chart of F, '9 ure 23 shows a modif ication of mode 
dec s on in the limitation means selecting means of the embodiment 3. With the third encoding device the 

?2fn°fT ?2'° n u made USi " 9 3 m ° ,i0n vectorfrom «« f«'d ff i«t field) to the even field (second 
f 2? 1 ™r fra o me K be '" 9 encoded - ,n R 9 ure 2 * the "lotion vector MV from this odd field to the ven 
field, shown in Figure 24 by motion vector Mv1 -2. 

frame T^^^* 2 *; "T""" **** S21 f ° ra " **■«*■■»■■ in the current 

moln tL£ f ' , i /I! 1 " 6 betWee " 8 h ° riZOntal """P 0 ™* W and a vertical component (y) of each 

T^;nT h T< ' nthe f °" 0Wrin9 mann6r Rret ' the h ° rizontal co «"P<»nents of the motion vectors are ar- 

Zl v Z h 9 P ° Wer ^ Va ' Ue ° f the mid d3ta beCOmes ,he media " val «« Mv x. The median 

Mv_y of the vertical components is found in a similar manner. 

entirlH 6 rlTZ ^T^^ ^ ^ KPTeSent P arame ters lowing the motion of the picture in its 
of the entire picture. The magnitude r may be found by the equat ion 3. 

r = \MV\ = VfMvx)* + (Mv_yf ..equation 3 
lim^n^T' limitati ° n m0de iS Cha " 9ed ^'depending °n the magnitude r. Since the first and second 
ITZ r J**?? more J mentorious for P' cturea having faster and slower movements, respectively, the sec- 
ond and firs hm,tat,on modes are selected if r is not more than a certain threshold and otherwfee.respect^ely 

old.reTpectilely 

frnm^HH r !?J "I! f ^[ th enCOdin9 d6ViCe ' the ' imitation mode selection is ^ing a motion vector 

ve^ Mv ™f ( J2 6 ? t0 eVe " f i6ld (SeC0 " d f ie ' d) ° f the current frame Wm> -cod*. The motion 
vectors Mv are found from the even fields to the odd fields for all of the macro-blocks in he slice beinc encoded 

2 TZ ir'TT (M /- X, . MV - y) ° f the h0ri20nta, and Vertteal ~"P™* thereof ttri mtrly: 
the above magnitude r is found, and the second limitation mode is selected if the value r is not more than a 
certam threshold value. If otherwise, the first limitation mode is selected 

the ISS!!?? TK Fi ? Ure ? fe 8 m0dif iCati °" ° f m ° de S6leCti0n by the limitation mode electing means of 
he embodiment 3 The limitation mode is selected using the correlation between the odd and even fields of 
the current frame being encoded. 

th. m^r'??" betWee " and 6Ven f feldS is achieved b * the method sh °wn ^ Figure 25. This is 
1^;?°"" "J? meth ,° d f ° r Sel6Ctin9 the macro " blod < "»■* in the international standardization 
of he moving picture encoding and compression now underway at ISO/IEC JTC1/SC2/WG11 With the ores 
ent embod ment, this method is extended and used for selecting the frame selecting mode ' ' 
In the flow chart shown in Figure 25, var 1 and var 2 are first found at step S1 . Then, at step S2 the number 

SSEJSd" mb 6 CUrre ' lt frame SatiSfyin9 re ' ati0n ^ 1 >= V " 2 + 00881 * f ° Und This nuZJt: 
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iSfs 3 ?„ ^ TT,^ ,S Preferab,y emP ' 0yed - Tnerefore ' tne second ,imitatto n mode is selected at 
for forth* ZcSng n0tm ° rethan aCertain tnreshold ' and the first limitation mode is elected otherwtee, 

That is if numj ield.mb <= threshold, the limitation mode is the second limitation mode of step S5 and 
if num_f,eld_mb > threshold, the limitation mode is the first limitation mode of step S4 
^llrT^' Wi 'J th6 « Urth enC ° di " 9 deViCe ' the n^ber of macro-blocks num_field mb satisfying the re- 
KTZ- .T V3 H r + ° f ! et in , the S,iCe bein9 enC ° ded iS f0Und in a simi,ar manner a "d the limitation mode 
h T u" Um - f teld - mb iS n0t m ° re tnan a certain thre shold, 'he second limitation 

mode is selected and, if otherwise, the first limitation mode is selected, for further processing 

the e^DoSm^t? ZIXEf j* 3 "f^ 0 " ° f mode se,ection by th « 'imitation mode selecting means of 
Son ^ h P . ' erenCe betWee " the previ0usly decoded P icture re ferred to by the mo- 
sls Q ?l w ?r CUrrent f T f ° r ^ ° f th6 macro - blo <* a ^ the current picture, is found, the square 
sums of the differences are found, and the limitation mode selection is made at step S12, using the thus found 

h^miZn 8 m J S r re T? ° f differenCeS ^ f ° Und With the firet and second limita «en mo^and 
the limitation mode having the lesser values of the square sums is selected 

Similarly with the fourth encoding device, the square sums of the differences in the slice being encoded 
are similarly found, and the limrtation mode having the lesser value of the squared sum is selected 

the Jmbo^nf? ? h Fi ? Ure , V fe 8 T W,Cati0n ° f m ° de SeleCti ° n by the ,imitation mode electing means of 
he embodiment 3 The limitation mode is selected using the correlation between the odd and even fields of 

the current frame. At step S51 of the flow chart of Figure 27, var 1 and var 2 are first found 

At step S52, the values var 1 and var 2 are summed together for all of the macro-blocks present in the 
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current frame. At step S53, the limitation mode is selected based on the thus found values var 1 and var 2. If 
var 1 >= var 2 + offset, the first limitation mode is selected and, if otherwise, the second limitation mode is 
selected. 

In the fourth encoding device, var 1 and var 2 are summed for all of the macro-blocks in the slice being 
5 encoded to find Var 1 and Var 2. The limitation mode is selected from the r lation between Var 1 and Var 2. If 
Var 1 <= Var 2 + offset, the first limitation mode is selected and, if otherwise, the second limitation mode is 
selected. 

Similarly, the flow chart of Figure 28 is a modification of mode selection by the limitation mode selecting 
means of the embodiment 3. With the third encoding device, limitation mode selection is made using the motion 
10 vectors and the correlation between the first and second fields of the current frame. At step S31 , the motion 
vectors of each macro-block, as found at step S31 , are converted into unit vectors [n_x[i], n_yp]. If the motion 
vectors are (mv_x, mv_y), the following equations 4 and 5 hold: 

n_x = mv_xt^l(mvj& + (mioO 2 ..equation 4 

15 n_y - mv_y I V(mvj0 2 + (mvyp ..equations 

At step S33, the sum vector SMV(S_x, S_y), as found by summing all of the unit vectors, is found. At step 
S34, the magnitude of the sum vector SMV divided by the number of the macro-blocks num_MB, as indicated 
by the equation 6, is denoted as R. 

20 

R - yl(S__x) 2 + (Sj/) 2 / num_MB 

. . equation 6 

- /<J>_x[i]) 2 ♦ <J> _yti]) 2 / nvmJSB 



The value R is a statistic quantity employed in verifying vector anisotropy. For example, if the motion vector 
exhibits anisotropy, that is if the picture in its entirety is moved significantly, the value R assumes a larger value. 
30 The limitation mode is set at step S36 from the relation between the value R and Var 2 as found from the 
flow chart of Figure 27. For example, if Var 2 is not more than a certain threshold and R is not more than a 
certain threshold, the second limitation mode is selected and, if otherwise, the first limitation mode is selected 
(step S37). 

Meanwhile, with the fourth encoding device, R and Var 2 are similarly found in the slice being encoded 

35 for selecting the limitation mode. If Var 2 is not more than a certain threshold and R is not more than a certain 
threshold, the second limitation mode is selected and, if otherwise, the first limitation mode is selected. 

The device of the present embodiment includes an address generator 35 for recognizing if the cyde is an 
odd cycle or an even cycle and controlling the frame memory group 10 for outputting the macro-blocks divided 
into blocks in association with the block-forming modes for orthogonal transform for the odd cycles if the lim- 

40 itation mode is the second limitation mode and also controlling the frame memory group 10 for outputting the 
macro-blocks divided into blocks in association with the block-forming modes for orthogonal transform for the 
odd and even cycles if the limitation mode is the first limitation mode, and a frame memory group fitted with 
a motion compensator 20, as motion compensation means, for receiving the processing mode information se- 
lected by the processing mode selecting means (frame motion prediction frame orthogonal transform / field 

45 motion prediction field processing mode data) and for executing the motion-compensated interframe or inter- 
field prediction responsive to the mode information. 

With the present encoding device, three encodings are possible, namely the intra-frame encoding (l-frame 
or l-picture), predictive interframe encoding (P-frame or P-picture) and bidirectional interpicture coding (B-fra- 
me or B-picture), as shown in Figure 44. Each picture is divided into blocks each consisting of 8 * 8 pixels, 

50 with 2*2 blocks, that is 16 * 16 pixels, making up each macro-block. 

It is noted that, with the encoding device of the embodiment 3, the above-mentioned first mode selecting 
means select which of the frame predictive mode or the field predictive mode is more efficient for motion com- 
pensation, whereas the above-mentioned first mode selecting means select which of the frame processing 
mode or the field processing mode is more efficient for orthogonal transform. Meanwhile, the selection of the 

55 first and the second modes is performed by the above-mentioned frame/field processing mode decision circuit 
33. 

With the encoding device of the embodiment 3, not only the mode selection is made by the processing 
mode s lecting means, but also the encoding is performed for each frame in accordance with one of the two 
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processing modes which is more efficient. That is, with the first limitation mode, direction into the blocks for 
orthogonal transform of the entire macro-blocks in each frame is carried out in accordance with the field proc- 
essing mode, only the odd fields in the macro-blocks are encoded in an amount corresponding to one frame 
during odd-numbered cycles and the even fields in the macro-blocks are encoded in an amount corresponding 

5 to one frame during even-numbered cycles. The odd-numbered and even-numbered cycles mean the periods 
of scanning of odd-numbered and even-numbered fields in interlaced scanning, respectively. With the second 
limitation mode, each macro-block is encoded by adaptively changing over between the frame processing 
mode and the field processing mode for each macro-block within a frame. The limitation mode selecting means 
decide which of these first and second limitation modes is more efficient for encoding and the more efficient 

10 limitation mode is selected. 

That is, with the above-mentioned second limitation mode, the mode of dividing each frame into blocks 
without dividing the frame into a first field or odd field and a second field or even field followed by encoding 
(the above-mentioned frame processing mode) is adaptively changed over to the mode of dividing each frame 
into the first and second fields and dividing the fields into blocks followed by encoding (the above-mentioned 

15 field processing mode) or vice versa in such a manner that the frame and field processing modes are used 
for a macro-block presenting small picture movements and a macro-block presenting significant picture move- 
ments, respectively. 

Consequently, if the frame processing mode is selected for the second limitation mode, motion prediction 
is made from the forward and backward frames for motion prediction for the P and B frames, and the differential 
20 picture from the prediction-coded picture is processed with DCT. On the other hand, if the field processing 
mode is selected for the second limitation mode, motion prediction for the P and B frames is made from the 
first and second fields of the forward and backward frames for each of the first and second fields of the macro- 
blocks, and the differential picture from the prediction picture is processed with DCT. From this it may be said 
that the second limitation mode represents encoding without intra-frame prediction, interframe. Besides, with 
25 the second limitation mode, encoding is performed within the odd-numbered cycles. Meanwhile, the second 
limitation mode may be defined as being intra-frame interf ield encoding. 

With the second limitation mode, motion prediction between the fields within a frame, that is between odd 
and even fields within the same frame, cannot be made. 

In this consideration, with the first limitation mode of the embodiment 3, division into blocks of all of the 
30 macro-blocks within each frame for orthogonal transform is made with the field processing mode. Specifically, 
only the odd fields in each macro-block are encoded for the odd-numbered cycles in an amount corresponding 
to one frame and subsequently the even fields in each macro- block are encoded for the even-numbered cycles 
in an amount corresponding to one frame. Therefore, with the present first limitation mode, since the odd fields 
(first fields) are encoded first, motion prediction for the even fields (second fields) may be made from the odd 
35 fields (first fields). Meanwhile, it may be said from this that the first limitation mode is frame encoding with 
intra-frame interfield prediction. 

Returning to Figure 20, the main flow of picture data to be encoded by the encoding device of the em- 
bodiment 3 is explained by referring to Figure 20. 

In this figure, digital picture signals are supplied to input terminal 1 so as to be stored in frame memory 
40 group 10. The above-mentioned 16 * 16 pixel unit macro-block data are read from frame memory group 10, 
under control by an address generator 35 as later described, and transmitted to a difference detector 12. The 
difference detector 12 is also supplied with motion-compensated picture data from the frame memory group 
fitted with motion compensator 20 as later described and a difference therebetween is detected by the differ- 
ence detector 12. 

45 An output of difference detector 12 is supplied to a DCT circuit 13 for orthogonal transform (DCT). The 
DCT coefficient data, produced by DCT by DCT circuit 13, is supplied to quantizer 14. Quantized data from 
quantizer 14 is outputted at output terminal 2 as encoded data via a buffer 16 and a variable length encoding 
circuit 15 for performing variable length encoding, such as Huffman coding or run-length coding. 

The frame memory group fitted with motion compensator 20 is supplied with quantized data from quantizer 

50 14 via a dequantizer 17, an inverse DCT circuit 18 and an additive node 19. The additive node 19 adds the 
output of the inverse DCT circuit 1 8 to the output of the frame memory group fitted with motion compensator 
20. Meanwhile, the information for inhibiting overflow of the buffer 16 is fed back to the quantizer 14. 

On the other hand, picture data outputted on the macro-block basis from the frame memory group 10 is 
transmitted to the fram motion det ction circuit 22 and the field motion detection circuit 21. 

55 The frame motion detection circuit 22 detects the sums of the differences of absolute values of the pixels 
and the motion vectors between the fram s on the macro-block basis and outputs the data (frame-to-frame 
motion vector data FMMV and data of the sums of the differences of the absolut values FMAD). On the other 
hand, the field motion detection circuit 21 detects the sums of the differences of absolute values of the pixels 
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the threshold TO, that is if the picture experi nces acute motion. 

Meanwhile, the decision by the limitation mode decision circuit 34 may also be given using the motion vec- 
tor data FDMVfrom the field motion detection circuit 21 . That is, it is also possible to select the second limitation 
mode if the motion vector data FDMV between the odd field and the even field is less than a certain threshold 
5 tO and to select the first limitation mode if the data FDMV is larger than the threshold tO. 

By the limitation mode data EN1/EN2 being transmitted from the limitation mode decision circuit 34 to the 
frame/field mode decision circuit 33, the frame processing mode data MDFM or the field processing mode data 
MDFD responsive to the encoding mode data EN1/EN2 is outputted from the frame/field mode decision circuit 
33. 

10 That is, if the limitation mode data from the limitation mode decision circuit 34 is the data EN1 indicating 
the second limitation mode, the frame/field mode decision circuit 33 performs an operation of adaptively chang- 
ing over the frame processing mode to the field processing mode or vice versa for each macro-block in one 
frame. Consequently, the frame/field mode decision circuit 33 outputs the adaptively changed over frame proc- 
essing mode data MDFM or field processing mode data MDFD. 

15 Conversely, if the limitation mode data from the limitation mode decision circuit 34 is the data EN2 indi- 
cating the first limitation mode, the frame/field mode decision circuit 33 performs the operation of division into 
blocks of all of the macro-blocks in one frame for orthogonal transform in accordance with the field processing 
mode. Consequently, the field processing mode data MDFD is outputted from the frame/field mode decision 
circuit 33. 

20 The frame/field orthogonal transform block-forming mode data MDFM/MDFD, outputted from the 

frame/field mode decision circuit 33, and the limitation mode data EN1/EN2 from the limitation mode decision 
circuit 34, are transmitted to the address generator 35 and to the frame memory group fitted with the motion 
compensator 20. Meanwhile, the processing mode data MDFM/MDFD, encoding mode data EN1/EN2 and the 
motion vector data FMMV/FDMV are also transmitted to the above-mentioned variable length encoding circuit 

25 15. 

The address generator 35 controls the frame memory group 10 to output picture data of the macro-blocks 
divided into blocks in accordance with the processing mode data MDFM/MDFD and the limitation mode data 
EN1/EN2 on the macro-block basis. Specifically, address generator 35 controls the frame memory group 10 
to output macro-blocks divided into blocks in accordance with the block-forming mode for orthogonal transform 

30 (data MDFM/MDFD) for odd cycles if the limitation mode data EN1/EN2 is the data EN1 indicating the second 
limitation mode, while controlling the frame memory group 1 0 to output macro-blocks divided into blocks in ac- 
cordance with the field processing mode (data MDFD) for odd and even cycles if the limitation mode data 
EN1/EN2 is the data EN2 indicating the first limitation mode. 

In other words, if, with the second limitation mode having been selected and the limitation mode data EN1 

35 being supplied to address generator 35, the processing mode data is MDFM indicating the frame-by-frame 
DCT, address generator 35 controls the frame memory 1 0 to output macro-blocks in which even and odd fields 
are alternately scanned, that is frame-based macro-blocks each combined from odd and even fields, as shown 
in Figure 3. That is, address generator 34 controls the frame memory group 10 to divide a macro-block having 
lines 1 to 16 into lines 1 to 8 and lines 9 to 16 and to output four of 8 * 8 blocks, as shown in Figure 3. 

40 On the other hand, if, with the second limitation mode having been selected and the limitation mode data 
EN1 being supplied to address generator 35, the processing mode data is MDFD indicating the field-by-field 
DCT, address generator 35 controls the frame memory 1 0 to output macro-blocks in which even and odd fields 
are scanned separately, that is separate field-based macro-blocks for even and odd fields, as shown in Figure 
4. That is, address generator 34 divides the lines 1 to 16 into lines 1, 3, 5, 7, 9, 13 and 15 (lines of the odd 

45 fields or the first fields) and lines 2, 4, 6, 8, 10, 12, 14 and 16 (lines of the even fields or the second fields), 
as shown in Figure 4, and to output two 8*8 blocks for each of these odd fields and even fields. 

On the other hand, if, with the first limitation mode having been selected and the limitation mode data EN2 
being supplied to address generator 35, address generator 35 controls the frame memory group 10 to output 
macro-blocks divided into blocks in accordance with the field processing mode for the odd and even cycles, 

so as described previously. That is, if the first limitation mode is selected, address controller 35 controls the frame 
memory group 10 so that two 8*8 blocks (only luminance components, as described subsequently) are out- 
putted at all times. Specifically, address generator 35 controls the frame memory group 10 so that the two 8 
* 8 block macro-block) is outputted in an amount corresponding to one frame (one picture) only for odd fields 
during the odd cycles, while controlling the frame memory group 10 so that the two 8*8 block (macro-block) 

55 is outputted in an amount corresponding to one frame (one picture) only for even fields during the even cycles. 

Th picture data outputted from the frame m mory group 10 contr Ned by address generator 35 is proc- 
essed with DCT by the DCT circuit 13, as described above. If, for example, the second limitation mode and 
the frame processing mode are s lected, DCT circuit 1 3 effectuates DCT on unit blocks of 8 * 8 pixels as shown 
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» MDFM/MDFD of DOT wocessta , .nd tofh. .. ? '"»* c "°"- OOceaslna mode data 

The above applies to the P-frame as well 

fen is the forwaVd predln f ° r * g - the B " frame - ,f ,he •"•*>■ 

macro-block for allowing to resize H wSl SIS ? '• J* I"* 88 * 5 ' t0 append extension bite to "» 
mode, the predictionTtha^ ,S for forward P redictto " — the field prediction 

field of the Lrrent frame ThaTis 2^^*^ "? eve "- mjmbered fieW » an odd-numbered 

The above applies to he P-frame as well 

As a modification, the number of the extension bits can be reduced to one for forward prediction. That is. 
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mode is decoded during the even cycle, it is necessary to know a macro-block address. There are two methods 
for grasping the macro-block address. One is to transmit the address of the macro-block for each macro-block 
of the even cycle as described previously. The other method is to store the information of the one-field field 
processing mode/frame processing mode information during the odd-numbered cycle and to calculate the ad- 
5 dress of the macro-block in the field processing mode from the string of each processing mode. The former 
method has an advantage that it is unnecessary to add memories, whereas the latter method has an advantage 
that the transmitted information is not increased. The same may be said of the quantization width if the quan- 
tization width is transmitted for each macro-block without storing one-field data during the above-mentioned 
odd-numbered cycle. 

10 The advantages of the fifth encoding device shown in Figure 34 are explained. In this figure, the blocks 
denoted by the same numerals as those of Figs.1 and 5 have the same function. Therefore, only the blocks 
denoted by different numerals from those of Figs.1 and 5 are explained. 

The high efficiency encoding device of Figure 34 includes, in addition to the blocks denoted by the same 
numerals as those of the high efficiency encoding device shown in Figs.1 and 5, an encoding mode decision 

is circuit 34(c) and a selector 24, as limitation mode selecting means, for selecting the first limitation mode of 
inhibiting the encoding of the entire macro-blocks in one frame by the above-mentioned frame processing mode 
or the second limitation mode of inhibiting prediction of the even f ield of the current frame from the odd f ield 
of the same frame in the entire macro-blocks in one frame, whichever is more efficient, selecting only the first 
limitation mode for the bidirectional predicted frame (B-frame) and inhibiting prediction of the even field from 

20 the odd field of the B-picture, and an address generator 35(c), as address generating means, for controlling 
the frame memory group to output odd field components of the entire macro-blocks and to subsequently output 
even field components of the entire macro-blocks in case of selection of the first limitation mode for one frame, 
as well as to output the macro-blocks sequentially by one slice at a time on the basis of the frame composed 
of the odd and even field components of the entire macro-blocks in case of selection of the second limitation 

25 mode. 

It is assumed that, with the encoding device of the embodiment 5, the picture sequence in the display 
time is BOo, BOe, Mo, He, B2o, B2e, P3o, P3e, B4o, B4e, P5o, P5e f as shown in Figure 35. 

The code sequence or decoding sequence of the present embodiment is Ho, He, BOo, BOe, P3o, P3e, 
B2o, B2e, P5o, P5e, B4o, B4e. 
30 Meanwhile, for decoding the codes by the second encoding device using a decoding device, playback is 
rendered possible by having three frame buffers, that is six fields, at the maximum. 

The operation of the decoding device having 3-frame frame buffers A, B and C is explained by referring 
to Figure 36. For using the frame buffers, the decoded pictures of the l-frames or P-frames are stored by al- 
ternately changing over between the frame buffers A a nd B. Display is made of the contents of the frame buffer 
35 opposite to that used for storage of the current frame and in the sequence of odd and even fields. In other 
words, for storing the picture in frame buffer A, the contents of the frame buffer B are displayed, whereas, for 
storing the picture in frame buffer B, the contents of the frame buffer A are displayed. Two frames need to be 
stored in the frame buffers so as to be used as reference frames for motion compensation of t he B- or P-frames 
to be decoded subsequently. 
40 For decoding the B-frame, the decoded picture is stored in frame buffer C. Display is made of the contents 
of the frame buffer C in the sequence of the odd fields and the even fields. If decoding is performed according 
to such rule, the entire components of 110 and the decoded picture of the even components of the macro-blocks 
of the frame-based block-forming frame-based prediction mode of He are stored at time 1 , while motion com- 
pensation is made at time 1e by referring to the contents of the frame buffer A at time 1e and the decoded 
45 picture of the even field components of the macro-blocks of the field-based block forming field-based predic- 
tion mode of He is stored at time 1e in frame buffer A. 

At time 10, and at time 1e, the odd and even components of frame buffer B are displayed, respectively. 
In the absence of the previous codes, the contents of the frame buffer B at this time point become indefinite. 

At this time 20, the pictures of the frame buffers A and B are motion-compensated, and the entire com- 
so ponents of BOo and the decoded picture of the even field components of the macro-blocks of the frame-based 
block forming frame-based prediction mode of BOo are stored. At time 2e, the pictures of the frame buffers A, 
B and C are motion-compensated, and the decoded picture of the even field-based components of the macro- 
blocks of the frame-based block forming frame-based prediction mode of BOe are stored. 

At time 2e, the pictures of the frame buffers A, B and C are motion-compensated, and the decoded picture 
55 of the even field components of the macro-blocks of the frame-based block forming-based frame prediction 
mode of BOe are stored in the frame buffer C. 

At time 2o and at time 2e, the odd components and even components of the frame buffer C are displayed, 
respectively. 
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Wh n BOe is displayed, the odd cycle of the B-frame is being decoded, such that both the com DO n*n* 

make motion compensation of the pictures from BOo to BOe, the picture of BOo needs to be stored ' 
Therefore, a one-frame frame buffer becomes necessary for the B-frame such that a th„~ fr L^ k ^ 
is required for decoding the codes formed by the second enLing deviS M "" ^ 

„„.„ hi *5 fift t h k e " c ° din 9 device < as sh °wn in Figure 37, the encoding mode of the B-frame is carried out 
ffw^2^FJ? ^ ^ PrediCti ° a ■"**» «'■" -n field Z a « EES 

L dispSd Th^ picture need ntJhH " ft" * ^ B °° * *°° dBd * time 2 ° 8 " d ^^neously BOo 
a, sP'ayed. Th.s pich^re need not be stored because it is not used for subsequent motion compensation 

vtded S TeZT^t^ thS ° 0dM Prepared by the f ™ encodi "9 devica — not be prl 

reduced ' ' 38 W " in 38 ' f ° r enabli " 9 the Size and - ««• -«no device to be 

the d^ rf ^I he * T bUffer AiS motio ^Pensated, and the entire components of P3o and 
the decoded p,cture of the evenfield components ofthe macro-blocks of the frame-based blockform inafram^ 

isL r,t on ri e i p3e are stored in frame buffer b - At *» ^z^z^zi^z 

fernng to the contents ofthe frame buffers Aand B and the decoded picture ofthe even field ^1^1^ 
J™*-, of the frame-based block forming field-based predLn nSKfTK? stoSTfrle 

At time 3e, the pictures of frame buffers Aand B are motion-compensated, and the decoded oicture of th* 

prrirerr^^^ 

spec^ej 6 ^ 31 °° mp0nentS 3nd even ^Ponents of the frame buffer Aare displayed, re- 

Subsequently, the decoding and display proceed in a similar manner 

39 th^ fe TL S L qUenCe fe B ° e ' B1 °' B16 ' ,2 °' ,2e ' B30 ' B3e ' P5o P5e. as shown in Figure 

B frlml h decoding ,s performed so that there are two B-frames between I and P frames or between two 

^eTasS 

two ^framT ^ te ° f 3 0386 Wherei " afe ™ th3n tW ° B frames betwee " or between 

h! IS? T n V, ^ S3me nUmeralS 38 th0Se of R 9 S - 1 and « have the same fcSZrSSwS 
the blocks denoted by different numerals from those of Figs.! and 5 are explained ' * 

nnmISc o ^ en ^° din9 ° f F, ' 9Ure 40 indudes - in addi «°" »o the blocks denoted by the same 

ZSd nd S a 6 22 !S ^ iC : enCy enCOding d6ViCe ShOW " Fi9S ' 1 and 5 ' a " encoding ^de deciS 
£h h- ? aselector 24 ' 88 limita «on mode selecting means, for selecting the first limitation mode of 

nhibrbngtheen^d-ngoftheentiremacre-blocksinoneframebytheabove-mentionedfr^ 
« e enfre m.cro-iocks in one frame, or the second limitation mode of hhfcCJ^SZ^S 
of the current frame from the odd field of the same frame, whichever is more eff talent se ectinc onlv the 22 
hmrtauon mode forthe bidirectional predicted frame (B-frame). inhibiting P ^°«tte*Z2^T* 
odd f,e.d of the IB-picture, and inhibiting prediction from an odd field of a frame wfS te K ^beTreferen^e 
fo forward pred.ct.on for the B-picture. and an address generator 35(d). as address generating meS^JST 
frohngtheframememorygrouptooutputodd field components ofthe entire tmJtoZSSEZ^^Z 
, rr" 18 ° f the 8ntire "blocks in case of seiecfion of the first Stotfo Tmode Z 
one frame, as well as to output the macro-blocks sequentially by one slice at a time on the baste rithZZZ 

B3o.*eToZ^ 

P5 n^£^2^ enCOdinQ d6ViCe ° f PreS8nt embodime "t is .20. 12e. BOo, BOe. B1o, B1 e. 

as JSfl!* S «H enCOd i n9 d ! ViCe ' Sh ° W " Fi9Ure 40 * forward P rediction fr° m a " odd field of the B-frame 
as used m the fifth encoding device, is inhibited, as shown in Figure 42. ' 
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nm ?T et T na /' thepiCture necess ary for prediction may be decoded by a decoding device having a buffer 
provided w h a frame (two fields) for backward prediction and a field for forward prediction, that is a buffer 
for three f i Ids, as shown in Figure 43. 

This will be explained by referring to Figure 41. 

In using th frame buffer, decoded pictures of I- or P-fram s are stored by changing over the field buffers 
in he sequence of the field buffers A. B. C, A, B. C. from field to field. When storage is initiated S the S 

AThect^ 

f 21 T f W l diSP ' ayed ' WhSreaS ' Whe " St0ra 9 e is initiated at the 1* b"««r B. the 
CaXstenTy Fordecod '"9 the B-frame. the encoded picture is not stored! but 

mJTJtTl 1 "& ? rf ?" A™!? thiS SeqUenCe> the f0 " 0Win9 operation is incurred - At '<>. since storage is 
initiated at the field buffer A, the contents of the field buffer B are displayed 

At le, since storage is initiated at the field buffer B, the contents of the field buffer C are displayed If there 

is no previously decoded picture, the display contents become indefinite 

fr^HTfl 0 ' l2 ?i" " S 6n ! rety SVen com P° nents of the macro-block of the frame-based block-forming 
frame-based prediction mode of I2e are decoded and stored in field buffers A and B, respectively 

of th» US ? \ ^ tto i n - com P ensati "9 the picture of the field buffer A, even components of the macro-block 
of the ^Id-based block-forming field-based prediction mode of I2e are decoded and stored in field bufferT 

At time 2o, since the picture to be encoded is the B-frame, the pictures of the field buffers A, B and C are 
21 betSTpn B0 ° deCOded - Th ^ecoded pictures are notstored butdisplayed instantly. Thesame 

may be said of BOe, B1o and B1e at time 2e, time 3o and at time 3e, respectively 

At time 4o, since storage is initiated at field buffer C, the contents of the field buffer Aare displayed. At 
time 4e, since storage is initiated at field buffer A, the contents of the field buffer B are displayed 

even Ioml 4 nl! he f P ir reS **** B ™ ™ tio "-«>mP«nsated and P3o in its entirety and 

even components of the macro-block of the frame-based block-forming frame-based prediction mode of P3e 
are decoded and stored in field buffers C and A. 

At time 4e by motion-compensating the pictures of the field buffers B, C and A, even components of the 
So btfrerl 6 3Sed b ' OCk - formin 9 f ie,d - based P rediction of P3e are decoded fand stored in 

It is seen from above that, with the sixth encoding device, decoding is made possible by a frame buffer 

in capacity, as shown in Figure 43 and the decoding device may be reduced in size and costs 

«in„I. J?"^ * b '. T"" ° f l ? 6 transmission buffer 16 ' shown in Figure 1, is multiplexed with encoded audio 

^m^ 

H a J.2 bi I| Strea T iS 'T*** 10 the deC ° der °" 3 transmissi °n medium, such as an optical disc. The playback 
date reproduced from the transmission medium is demodulated and corrected for errors. If the bit stream is 
multiplexed with audio s,gnals. synchronization signals etc., it is separated from these signals 

tr™ 22? th t bit Slream 0utputted from tne encoder is re ^ded herein on the optical disc it may also be 
transmitted to a transmission channel for ISDN or satellite communication 

With the above-described first and second high efficiency encoding devices, field-by-field moving pictures 

SrA^rT n r t ? r aCUte , m0ti ° n may be Pr ° CeSSed eff 00 the or frame-by-frame 

f to d 1 I 2?? hi9h 6ff idenCy enC ° di " 9 device ' il is V**™* to P redict an even-numbered 

field from an odd-numbered field of the current frame and to select the encoding with higher efficiency. There- 
fore, a h.gh-qual,ty mov.ng p.cture may be reproduced by the high efficiency decoding device of the present 
invention despite the small volume of the transmitted information 

inhiS !l!!t abOV t deSCr j bed ,hind and f ° Urth hi9h efficiency encodi " 9 devices - since tne frame prediction 
'*< T° 9 ° Ver t0 tHe m0d6 ° f inh,bitin9 prediction of the aven-numbered field from the odd- 
S2S2?f cu "ent frame or vice versa on the frame-by-frame or slice-by-slice basis, address gen- 
erating means for encoding and address generating means for decoding may be simplified to enable the hard- 
ware to oe reduced in size. 

bv f Shl^ * th H h .S h effi ^ ien fr encodin 9 device . s '"~ the B-frame is processed in its entirety on the f ield- 
by-field basis and the mode of mhibiting prediction of the even-numbered field from the odd-numbered field 

' 8 ^ ° Ver ° n thefra ™- b y-frame or slice-by-slice basis, it becomes possible to use 
the frame buffer having two frames or four fields for t he decoding device 

and atVframMh^ ^ 1 ^ P ° SSib,e t0 USe the fra ™ ™ 
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The first to sixth decoding devices may be used in conjunction with the first to sixth encoding devices for 
realizing high efficiency decoding. 

Since compressed data encoded by the above-described high efficiency encoding devices are recorded 
on the recording medium according to the present invention, it becomes possibl to record more picture data, 
5 that is picture data of longer time duration, on the recording medium. 



Claims 

10 1. A picture signal encoding method for encoding data representing interlace scanned pictures, comprising 
the step of: 

receiving interlace scanned picture data; and 

transforming said interlace scanned picture data by adaptively selecting frame-based DCT transforma- 
tion or field-based DCT transformation. 
15 2. A picture signal encoding method according to claim 1. further comprising the step of dividing said in- 

terlace scanned data into macro-blocks, and selecting field-based or frame-based DCT transformation for each 
macro-block. 

3. A picture signal encoding method according to claim 1. further comprising storing a preceding frame of 
interlace scanned data; providing compensation for movement between received interlace scanned picture 

20 data and the preceding frame of interlace scanned data to produce predictive picture data; and 

subtracting said predictive picture data from said received interlace scanned picture data to produce pic- 
ture data for transformation. 

4. A picture signal encoding method according to claim 3, wherein the step of providing compensation com- 
prises adaptively selecting frame-based movement compensation or field-based movement compensation. 

25 5. A picture signal encoding method according to claim 4, wherein said interlace scanned data is divided 
into macro- blocks and selecting frame-based or field-based movement compensation for each macro-block. 

6. A picture signal encoding method for encoding interlace scanned picture data, comprising the steps of: 
receiving a frame of interlace scanned picture data, said frame including first and second fields of picture 

data; and 

30 encoding said interlace scanned picture data by adaptively selecting a first encoding technique from 

which a second field of picture data is predictable from a first field of picture data in the same frame or a second 
encoding technique from which a second field of picture data cannot be predicted from a first field of picture 
data in the same frame. 

7. A picture signal encoding method according to claim 6, wherein said f irst encoding technique includes 
35 the steps of 

dividing each frame into blocks of picture data derived from said first field and blocks of picture data 
derived from said second field; and 

orthogonally transforming said blocks. 

8. A picture signal encoding method according to claim 6, wherein said second encoding technique includes 
40 the steps of dividing each frame into macro-blocks of picture data, each macro-block containing plural blocks; 

selectively changing over between field division of blocks in which the blocks of a macro-block are separated 
into blocks from said first field and blocks from said second field, respectively, and field non-division of blocks 
in which the blocks of a macro-block are separated into blocks from both said first and second fields; and or- 
thogonally transforming the field division blocks and the field non-division blocks. 
45 9. A picture signal encoding method according to daim 6, wherein said step of encoding includes generating 
head information for the encoded picture data; and further comprising adding ID data to said header informa- 
tion to distinguish said first encoding technique from said second encoding technique. 

11. A picture signal encoding method for encoding a frame of interlace scanned picture data, with each 
frame having first and second fields, said method comprising the steps of: 

50 encoding said first field to produce first encoded data; 

decoding said first encoded data to produce first decoded data; 
producing predictive picture data from said first decoded data; and 

using said predictive picture data to encode said second field to produce second encoded data. 

1 2. A picture signal encoding method according to claim 1 1 , wherein said predictive picture data is produced 
55 by using most recently encoded and decoded data from said first field in accordance with a picture encoding 

techniqu selected from the group consisting of intra-fram encoding and predictive picture encoding. 

13. A picture signal ncoding method according to claim 11, further comprising the step of dividing ach 
field of picture data into macro-blocks; and said second field is encoded by adaptively selecting a first encoding 
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technique for a macro-block by using a differ nt between said second field and said predictive picture or a 
second encoding technique for said macro-block using only said second field. 

14. A picture signal encoding method for encoding interlace scanned picture data by selectively encoding 
said picture data by an intra-coded picture encoding technique or a predictive coded picture encoding techni- 

5 que, the picture data having field intervals, said method comprising predicting a field to be encoded using said 
predictive coded picture encoding technique by decoding the two last fields previously encoded by a selected 
one of said intra-coded picture encoding techniques or said predictive coded picture encoding technique. 

15. A picture signal encoding method according to claim 14 comprising generating header information for 
the encoded picture data and adding ID data to said header information to identify the encoded fields which 

10 are used to predict said field to be encoded. 

16. A picture signal encoding method for encoding interlace scanned picture data by a bidirectionally-pre- 
dictive coded picture encoding technique, comprising: 

storing picture data from a previously encoded frame; 
storing picture data from a following frame to be encoded; and 
15 predicting a field in a current frame to be encoded by said bidirectionally coded picture encoding tech- 

nique by using stored picture data from said previously encoded frame and stored picture data from said fol- 
lowing frame but not picture data from another field of the current frame to be encoded. 

17. A picture signal encoding method according to claim 16, further comprising generating header infor- 
mation for the encoded picture data and adding ID data to said header information to identify which fields in 

20 said previously encoded frame and in said following frame are used to predict said field. 

18. A picture signal encoding method according to claim 16, wherein said field is predicted from both fields 
of said previously encoded frame and both fields of said following frame. 

19. A picture signal encoding method for encoding interlace scanned pictures having frame intervals 
formed of field comprising the steps of selectively predicting a current picture by frame-based movement com- 

25 pensation or field-based movement compensation of successive pictures; providing frame-based DCT trans- 
formation of the inter lace scanned pictures when frame-based movement compensation is provided; and pro- 
viding field- based DCT transformation of the interlace scanned pictures when field-based movement uompen- 
sation is provided. 

20. A picture signal encoding method for encoding interlace scanned picture data formed of frames having 
30 odd and even fields and in which said picture data is selectively encoded by an intra coded picture encoding 

technique, a predictive coded encoding technique or a bidirectionally-predictive coded picture encoding tech- 
nique, said method including the step of predicting an even field of a present frame to be encoded from an 
odd f ield of the same frame when either said intra coded picture encoding technique or said predictive coded 
picture encoding technique is selected for encoding but not when said bidirectionally-coded picture encoding 
35 technique is selected for encoding. 

21. A picture signal encoding method for encoding interlace scan picture comprising, 

encoding said interlace scan picture by using a fixed quantization width with interf ield prediction within 
one frame, 

encoding said interlace scan picture by using a fixed quantization width without inter-field prediction 
40 within one frame, 

encoding said interlace scan pictures by using a controlled quantization width with or without said inter- 
field prediction within one frame. 

22. A picture signal decoding method for encoded data representing interlace scanned pictures, comprising 
the steps of receiving said encoded data and inverse transforming said encoded data by adaptively selecting 

45 frame-based IDCT transformation or field-based IDCT transformation to recover decoded picture data. 

23. A picture signal decoding method according to claim 22, wherein said received encoded data is divided 
into macro-blocks, and frame-based or field-based IDCT transformation is selected for each macro-block, said 
selecting is in a macro-block as a unit. 

24. A picture signal decoding method according to claim 22, further comprising the steps of storing previ- 
50 ously decoded picture data, sensing motion between a picture represented by the stored picture data and pre- 
sently decoded picture data, motion compensating the stored picture data in response to the sensed motion 
to produce predictive picture data, and adding said predictive picture data to said presently decoded picture 
data to produce picture data for storing. 

25. A picture signal decoding method according to claim 24, wherein the step of motion compensating com- 
55 prises adaptively selecting frame-based motion compensation or f ield-based motion compensation. 

26. A picture signal decoding m thod according to claim 25, wherein said encoded data is r ceived in mac- 
ro-blocks, and wherein frame-based or field-based motion comp nsation is selected for an entire macro-block. 

27. A picture signal decoding method for encoded interlace scanned picture data comprising the steps of: 
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storing a previously received frame of picture data, said frame including first and second fields; and 
decoding said encoded picture data by adaptiveiy selecting a first decoding technique from which a sec- 
ond field of picture data is predictable from a first field of decoded picture data in the same frame or a second 
decoding technique from which a second field of picture data cannot be predicted from a first f i Id or decoded 
5 picture data in the same frame. 

28. A picture signal decoding method according to claim 27, wherein said first decoding derives blocks of 
picture data to form a frame and where in each block is formed of picture data from both said first and second 
fields of said frame. 

29. A picture signal decoding method according to claim 27, wherein said second encoding technique forms 
w a frame from macro-blocks of decoded picture data, each macro-block containing plural blocks, and includes 

the step of selectively ohanging over between field construction of a macro-block in which blocks from said 
first field and blocks from said second field are combined into a macro-block, and field non-construction in 
which blocks from both said first and second fields are combined into a macro-block. 

30. A picture signal decoding method according to claim 27, wherein said first or second decoding tech- 
15 nique is selected for each frame. 

31. A picture signal decoding method according to claim 27, wherein the encoded picture data includes 
header information include ID data to identify the encoding technique of said encoded picture data and the 
step of selecting is responsive to said ID data. 

32. A picture signal decoding method for frames of encoded interlace scanned picture data with each frame 
20 having first and second fields, said method comprising the steps of: 

decoding said first field to produce first decoded data, 
producing predictive picture data from said first decoded data; and 

using said predictive picture data to decode said second field to produce decoded interlace scanned 
picture data. 

25 33. A picture signal decoding method according to claim 32, wherein said predictive picture data is pro- 
duced by using most recently decoded data from said f irstf ield in accordance with a picture encoding technique 
selected from the group consisting of infra-frame encoding and predictive picture encoding. 

34. A picture signal decoding method according to claim 32, further comprising the step of constructing 
each field of picture data from macro-blocks; and said second field is decoded by adaptiveiy selecting a first 

30 decoding technique for a macro-block by using a difference between said second field and said predictive pic- 
ture or a second decoding technique for said macro-block using only said second field. 

35. A picture signal decoding method for encoded interlace scanned picture data which has been encoded 
by an intra coded picture encoding technique or a predictive coded picture encoding technique, the picture data 
having field intervals, said method comprising predicting a field to be decoded using said predictive coded pic- 

35 ture encoding technique by using the two last decoded fields previously decoded by a selected one of said 
intra coded picture encoding technique or said predictive coded picture encoding technique. 

36. A picture signal decoding method wherein the encoded interlace scanned picture data includes head 
information including ID data to identify the encoding technique that had been used for encoding and further 
comprising the step of decoding said ID data to distinguish the fields of predicting. 

40 37. A picture signal decoding method for encoded interlace scanned picture data which has been encoded 
by a bidirectionally-predictive coded picture encoding technique, comprising: 

storing picture data from a previously decoded frame and from a following frame to be decoded; and 
predicting a field in a current frame that has been encoded by using said bidirectionally coded picture 
encoding technique by using the stored picture data from the previously decoded frame and stored picture data 
45 from the following frame but not picture data from another field of the current frame. 

38. A picture signal decoding method according to claim 37, wherein the encoded picture data includes 
header information with ID data to identify which fields in the previous and following frames are to be used to 
predict said field, and said step of predicting includes decoding said ID data to select the fields which are used 
for said predicting. 

so 39. Apicture signal decoding method according to claim 37, wherein said field is predicted from both fields 
of said previously decoded frame and from both fields of said following frame. 

40. High efficiency encoding apparatus for encoding input picture data in the form of frames, each frame 
having a pair of fields, comprising: 

means for dividing said picture data into macro-blocks, each formed of a two-dimensional array of plural 

55 pixels; 

motion detection m ans for det cting frame motion vectors between fram s as a function of macro- 
blocks in resp ctiv frames and ford tecting field motion vectors between fields as a function or macro-blocks 
in resp ctive fields; 
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first mod selecting means responsive to said motion detection means for selecting a frame prediction 

™ d ^ 

se ~ n J m ° d se |ec «r.g means responsiv to said motion detection means for s lecting a fram proc- 
^.ngm^eortransformingablockofdatafbrmedof pixels from said pair of fields or a field p^lm^ 
for transform.ng a block of data formed of pixels from only one field- Processing mode 

ZZSZ 7 7 m ° tl0n 1 COmpensation or in acco ^nce with said field prediction mode by using saW 
TZ ™ Per Z n 35 Se '? 6d by S3id f ifSt m ° de Se,ectin 9 means to P rod "<* ** wooded data and 

or bv f !m T ^ T ea " S f ° r enCOdinfl Sa ' d f iret enC0ded data b * frame ^ orthogonal transformaSon 
or by .eld orthogonal transformation as selected by said second mode selecting mean? 

havinn'odi TJST* r T^ 9 enCOdin9 inpUt picture data in the form ° f each frame 

Having odd and even fields, comprising: 

pixels; meanSfordividin9 said picture data inl ° macro-blocks, each formed of a two-dimensional array of plural 
h.^ c m0ti ° n d ^ eCt i° n meanS f0f deteCting frame motion vectora between frames as a function of macro- 

mnri. r™ Sel ?? n9 meanS responsive to sa ' d motion detection means for selecting a frame prediction 

» n r y,n9 tionMm 

second mode selecting means responsive to said motion detection means for selecting a frame orac- 

for transforming a block of data formed of pixels from only one field- 

third mode selecting means for selecting a first structure mode or a second structure mode the first 
structure mode acting to inhibit encoding of all of the macro-blocks in one frame when said ^e^ocess S 

z: ::ZnLz d zr°" d s *r re r de ac * n9 to inhiwtthe *«■ ™ ™ <ezs 

rrame being encoded from a previously encoded odd field of the same frame- 

predictive encoding means for encoding said input picture data in accordance with said selected field 

iT^^rT**?"' SaW SeleCted framS ° rfie,d Predic « 0n mode and said sele'S M orfecind 
structure mode to produce first encoded data; and 

transform encoding means for encoding said first encoded data by orthogonal transformation in accor- 
dance with the selected processing mode and structure mode, 'iransiormationinaccor- 
42 The high efficiency encoding apparatus of claim 41, wherein said prediction mode is operative to oro- 

sa^fLr ^ Cb f 0na,ly Pred ; Cted PiCtUre< and ^ Sa,d third mode — *> «« * °Pe able to oSy 
said first structure mode for a bidirectionally predicted picture y 

du JiiSS^S! Bf I e 'L COdin9 aPParatuS ° f daim 41> wnerein «* P red ietion mode is operative to pro- 

TZH T *TS* S3id thW m0dS Se ' eCtin9 means inhibite Paction Sf an even S 

TZ^l l y 6nC ? ed 041 fi6ld ° f tHe Same piCture f0ra ^irectionally predicted picture. 

mJiS^JSS^ 00 ^ 9 - 3Pf ! aratUS ° f daim 42 ' Wh6rein Said third mode se,ect,n 9 m eans is op- 
erate to inhibit pred,ct,on from a previously encoded odd field ofa previous frame for a bidirectionally predicted 

horizontal iTj!!^ ^l" 9 ° f ^ 41 ' tne teme and f ie ' d ™tion vectors include 

™2 h t ?L C0mp0nents ' and fflkl tnird mode selecting means includes means for determining a 
parameter md.cat.ng the size of motion of an entire picture from a median value of each of the horizonte and 

rixtf ? mo ; ion ; ector> and saw ,hird mode seiectin9 means --^iS^is 

structure mode as a function of said parameter. 

mM !!'fL h H 1 i9h effiCfenCy enCOdi " 9 ^^ee^'e^^-^ereinsaidthirdmodeselecting means includes 

m M !I'fL he I 6f ■ iCie " Cy enCOdin9 aPP3ratUS ^^'"^•^ereinsaidthirdmodeselecting means includes 
^ » J™. , a , SqUared SUm ° f differenCeS between a ^cro-block ofa current frame being encoded 

and a s.m.larly posted macro-block in a previous frame indicated by the motion vector, said third mooeTe- 
lectmg means selecting first or second structure mode as a function of the squared sum 

m a nM?L,' 9h effiCienCy e r COdi " 9 apParatUS ° f Claim 41 ' wnerein said third mode selecting means includes 
LZi™ S M !! f 1 ? 8 ^ " b6tW e " ° dd and even f ie,ds of a fra ™ and means for adding values cor! 

J 2, ? f T* C ° rrelati0n f ° r a " maCT °- b,ock e Present in a current frame being enLed to Z 

duce a sum va.ue. whereby said first or second structure mode is selected d pending on the sum vale 
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49. The high efficiency encoding device for encoding picture signals as claimed in claims 41 , wher in said 
structure mode selecting means detects vector anisotropy from the motion vectors of the entire detected mac- 
ro-blocks and selects said first or second structure mode based on values corresponding to said vector ani- 
sotropy summed to values corresponding to correlation between odd and even fields of the current frame being 

5 encoded over the entire macro-blocks. 

50. High efficiency encoding apparatus for encoding input picture data in the form of frames, each frame 
having a pair of fields, comprising: 

means for dividing said picture data into macro-blocks, each formed of a two-dimensional array of plural 

pixels; 

10 motion detection means for detecting frame motion vectors between frames as a function of macro- 

blocks in respective frames and for detecting field motion vectors between fields as a function of macro-block 
in respective fields;, 

mode selecting means responsive to the picture data in a micro-block for selecting a frame prediction 
and a frame processing mode for carrying out frame motion compensation and for transforming a block of data 
15 comprised of pixels from both fields in a frame, or a field prediction and a field processing mode for carrying 
out field motion compensation and for transforming a block of data comprised of pixels from only one field; 

predictive encoding means for encoding said input picture data in accordance with said frame prediction 
mode by using said frame motion compensation and said frame motion vector, or in accordance with said field 
prediction mode by using said field motion compensation and said field motion vectors to produce first encoded 
20 data; and 

transform encoding means for encoding said first encoded data by orthogonal transformation or by field 
orthogonal transformation as selected by said mode selecting means. 

51. High efficiency decoding apparatus for decoding received encoded picture data comprising: 
inverse variable length decoding means for decoding the received encoded picture data to reproduce 

25 motion vector information, prediction mode information indicating whether motion compensation is based upon 
blocks of picture data in which the picture data is derived from one or both fields of a frame, processing mode 
information indicating whether the encoded data is orthogonally transformed on the basis of a macro-block 
formed of picture data derived from one or both fields of said frame, and encoded picture data; 

inverse transforming means for decoding said encoded picture data by using the inverse orthogonal 
30 transform in accordance with said processing mode information to produce first decoded picture data; and 
prediction decoding means for decoding said first decoded picture data by using motion compensation 
determined by said motion vector information and said prediction mode information. 

52. High efficiency decoding apparatus for decoding received picture data comprising: 

inverse variable length decoding means for decoding the received encoded picture data to reproduce 
35 motion vector information, prediction mode information indicating whether motion compensation is based upon 
blocks of picture data in which the picture data is derived from one or both fields of a frame, processing mode 
information indicating whether the encoded data is orthogonally transformed on the basis of a macro-block 
formed of picture data derived from one or both fields of said frame, encoded picture data, and structure mode 
information indicating if the frame is encoded with a first structure mode in which all of the macro-blocks in 
40 one frame are inhibited from being encoded in accordance with the frame processing mode or if the frame is 
encoded with a second structure mode in which prediction of an even field of a current frame from an odd field 
thereof is inhibited from ail macro-blocks in said frame; 

inverse transforming means for decoding said encoded picture data by using the inverse orthogonal 
transform in accordance with said processing mode information and said structure mode information to pro- 
45 duce first decoded picture data, 

prediction decoding means for decoding said first decoded picture data by using motion compensation 
determined by said motion vector information, said prediction mode information and said structure mode in- 
formation. 

53. High efficiency decoding apparatus for decoding received encoded picture data comprising: 

50 inverse variable length decoding means for decoding encoded data to reproduce the motion vector in- 

formation, the prediction mode information indicating which of the block division for motion compensation, the 
processing mode information indicating which of the block division for orthogonal transform on the basis of a 
frame in a macro-block or the block division for orthogonal transform on the basis of a field in the macro-block 
is more eff ici nt and encoded picture data and a macro-block address increment in the header information for 

55 the macro-block, 

address generating means for calculating an address incr ment value for a frame buffer from said mac- 
ro-block address increment to find a leading address of each macro-block to accord said leading address to 
said frame buffer,and 
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motion compensating means for adding a relative address of said macro-block other than said leading 
address to said frame buffer to access data and for receiving said detected motion vectors, said processing 
mode information and said structure mode information, said motion compensation means xecuting prediction 
between motion-comp nsatedfram soffi Ids in association with said processing mode information and said 
5 structure mode information and transmitting the motion-compensated picture signals to said frame buff r. 

54. A high efficiency decoding device for decoding picture signals comprising 

inverse variable length decoding means for decoding encoded data to reproduce the motion vector in- 
formation, the prediction mode information indicating which of the block division for motion compensation, the 
processing mode information indicating which of the block division for orthogonal transform on the basis of a 
10 frame in a macro-block or the block division for orthogonal transform on the basis of a field in the macro-block 
is more efficient, encoded picture data and the structure mode indicating the frame encoded with which of a 
first structure mode of inhibiting the encoding of the entire macro-blocks in one frame in accordance with said 
the frame processing mode or a second structure mode of inhibiting the prediction of the even field of a current 
frame being encoded from the odd f ield thereof for the entire macro-blocks in one frame and a macro-block 
15 address increment in the header information for the macro-block, 

address generating means for calculating an address increment value for a frame buffer from said mac- 
ro-block address increment to f ind a leading address of each macro-block to accord said leading address to 
said frame buffer.and 

motion compensating means for adding a relative address of said macro-block other than said leading 
20 address to said frame buffer to access data and for receiving said detected motion vectors, said processing 
mode information and said structure mode information, said motion compensation means executing prediction 
between motion- compensated frames or fields in association with said processing mode information and said 
structure mode information and transmitting the motion-compensated picture signals to said frame buffer. 

55. The high efficiency decoding device for decoding picture signals as claimed in claim 52, wherein said 
25 processing information includes, for the bidirectionally predicted picture, the encoding information of selecting 

the encoding of inhibiting motion compensation and block division for orthogonal transform based on a frame 
for the entire macro-blocks in one frame and the encoding information of inhibiting the prediction of an even 
field from an odd field of said picture. 

56. The high efficiency decoding deice for decoding picture signals as claimed in claim 55, wherein char- 
30 acterized in that said processing information includes, for the bidirectionally predicted picture, the encoding 

information of inhibiting prediction from an odd field of a reference frame for forward prediction. 

57. A recording medium on which are recorded an encoded bitstream comprising: 
encoded picture data produced by using predictive encoding and transform encoding, 
prediction mode data used in said predictive encoding, 

35 motion vector data produced by using said pred ictive encoding , and processing mode data used in trans- 

form encoding. 

58. A recording medium according to claim 57, wherein said bitstream further comprises structure mode 
data indicating a first encoding technique in which a second field of a frame is predictable from a first field of 
the same frame, or a second encoding technique in which said second field cannot be predicted from said first 

40 field. 
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